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PLANS 


O Install and evaluate components at Langley as 
they become available | 


O Use ENCOMPASS prototype to examine more 
advanced features 


O Prototype will be used to examine the practical 
applications of SAGA 


1-27 


Cognitive-Based Analysis of 
Software Documentation! 


Elliot Soloway 
Associate Professor of Computer Science 
| and Psychology 
Cognition and Programming Project 
(CAPP) 
Computer Science Department 
Yale University 
New Haven, CT 06520 


This research was supported in part by the Jet Propulsion Laboratory California 
Institute of Technology under contract with the National Aeronautics and Space 
Administration, and by the National Sclence Foundation grant DCR - 8302382. 


1 resented 11/18/86 by David Littman 


1-28 


TODAY’S TALK 


e THE PROBLEM OF DOCUMENTATION IN MAINTENANCE 
CONTEXT 


e SOME OF THE ISSUES WE HAVE STUDIED EMPIRICALLY 


e A TASTE OF THE RESULTS OF OUR STUDIES 
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THE PROBLEM WITH 
DOCUMENTATION 


e CONSTANTLY ENHANCING PROGRAMS 
e ENHANCER IS NOT ORIGINAL PROGRAMMER 


e BASIC PREMISE OF PROGRAMMERS: 
DON’T TRUST DOCUMENTATION 
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| OUR APPROACH: 
THE COGNITIVE PERSPECTIVE 


e THREE ISSUES IN DOCUMENTATION 
o WHAT TO DOCUMENT? 


o HOW TO DOCUMENT? 
o WHEN TO PRESENT THE INFORMATION? 


e OUR ANSWERS TO 3 QUESTIONS ARE BASED ON 
COGNITIVE PRINCIPLES 
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OUR METHODOLOGY: 
(IN A NUTSHELL) 


e "YOU CAN OBSERVE A LOT BY JUST WATCHING." 
Yogi Berra 


e"YOU HAVE TO GO DOWN THE ROPE HAND-OVER- 
HAND." 
JPL Guru 


2 AREAS OF STUDY AT JPL 


e AREA 1: EXAMINING THE WHAT QUESTION 


o PROGRAMMER’S USE OF CURRENT 
DOCUMENTATION 


o CAN WE IMPROVE IT? 


0 STUDY DONE IN CONTEXT OF SMALL PROGRAM 
(300 LINES OF FORTRAN) 


o TASK: MAKE AN ENHANCEMENT 
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2 AREAS OF STUDY AT JPL 
(CONTINUED) 


e AREA 2: EXAMINING THE WHAT & WHEN QUESTIONS 


0 PROGRAMMERS CONFRONT LARGE PROGRAM (60K 
LINES) 


01.5 FEET OF DOCUMENTATION 


o TASK: MAKE AN ENHANCEMENT 
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AREA 1 STUDY: "WHAT" QUESTION 
PHASE I 


e METHODOLOGY: 


o GIVE PROGRAMMERS SMALL PROGRAM + 
STANDARD DOCUMENTATION 


o ASKED THEM TO ENHANCE PROGRAM 
°o VIDEOTAPED PROBLEM SOLVING BEHAVIOR 
o RECORDED "TALKING ALOUD" PROTOCOLS 


°o 10 JPL PROFESSIONALS 
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RESULTS: "WHAT" QUESTION 
PHASE I 


e IDENTIFIED 2 PROGRAM STUDY STRATEGIES USED TO 
BUILD MENTAL MODEL OF PROGRAM 


o SYSTEMATIC: MENTAL SIMULATION USED TO SEE 
HOW WHOLE PROGRAM FITS TOGETHER BEFORE 
ATTEMPTING ENHANCEMENT 


o AS-NEEDED: GO FOR THE PATCH AS SOON AS 
POSSIBLE 


eIF ADOPT SYSTEMATIC STRATEGY ----> CORRECT 
PATCH 


eIF ADOPT AS-NEEDED STRATEGY ----> INCORRECT 
PATCH 


e NO EFFECT AT ALL OF PROGRAMMING EXPERIENCE!!! 


DISCUSSION: "WHAT" QUESTION 
| PHASE I 


e SMALL PROGRAM --- SYSTEMATIC STRATEGY POSSIBLE 
e BIG PROGRAM --- SYSTEMATIC STRATEGY IMPOSSIBLE 


e QUESTIONS: 


°o WHAT INFORMATION DID SYSTEMATIC STRATEGY 
UNCOVER? 


o CAN THAT INFO BE PUT IN DOCUMENTATION? 


o WILL THAT INFO HELP THE £AS-NEEDED 
STRATEGY? 
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AREA 1 STUDY: "WHAT" QUESTION 
PHASE 


e GOAL: FACILITATE AS-NEEDED STRATEGY 


e METHOD: PROVIDE KEY INFO IN DOCUMENTATION 
0 CAUSAL INTERACTIONS AMONG DELOCALIZED 
PLANS 


e ANOTHER STUDY: 
NEW DOCUMENTATION vs. OLD DOCUMENTATION 


@ PRELIMINARY RESULTS: 


oNEW DOC APPEARED TO HELP AS-NEEDED 
STRATEGY 


o SUBJECTS WITH MORE EXPERIENCE ESPECIALLY 
BENEFITTED 


o INTERESTING!! 


| AREA 2 STUDY: 
"WHAT" & "WHEN" QUESTIONS 


e CAN WE PROVIDE KEY INFO WHEN IT IS NEEDED? 


e KEY INFO: GOALS --- WHAT IS PROGRAM/MODULE 
SUPPOSED TO DO? 


e PROVIDE KEY INFO UP FRONT --- NICELY LABELLED 


e LARGE PROGRAM CURRENTLY USED SUCCESSFULLY AT 
JPL (60K LINES) 


e LARGE DOCUMENTATION (1.5 FEET) 
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METHODOLOGY: 


e CURRENT DOC vs. REVISED DOC 


e REVISION TRIED TO CLARIFY STRUCTURE OF 
DOCUMENTATION 


e 4 JPL PROGRAMMERS: 
(2 ON EACH FORM OF DOCUMENTATION) 


e ASK PROGRAMMERS TO MAKE ENHANCEMENT 


e ENHANCEMENT ACTUALLY REQUIRED CHANGING ONLY 
ONE MODULE 
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RESULTS 


e OLD DOC: 2 HOURS TO FIND WHERE TO MAKE CHANGE 


e NEW DOC: 20 MINUTES TO FIND WHERE TO MAKE 


e BIG DIFFERENCE (BUT ONLY FOUR SUBJECTS ....) 
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e WE KNOW PROGRAMMERS BUILD MENTAL MODELS OF 
PROGRAMS 


e THE ISSUES HERE ARE: 


o PROGRAMMERS NEED TO BUILD MENTAL MODELS 
OF DOCUMENTATION 


o HOW CAN WE HELP THEM BUILD MENTAL MODELS 
OF DOCUMENTATION? 
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THE POINT IS: 


e FOR LARGE PROGRAMS, NEED CLEAR UNDERSTANDING 
OF STRUCTURE OF DOCUMENTATION 


e THAT IS A MENTAL MODEL 


eWE SAW THEM BUILD MENTAL MODELS OF 
DOCUMENTATION: 


o CURRENTLY RELEVANT: 
"I NEED TO KNOW THIS FOR WHAT I’M DOING 
NOW" 


o POTENTIALLY RELEVANT: 
"I MIGHT NEED TO KNOW THIS FOR SOMETHING I 
DO LATER" 


o IRRELEVANT: 
"I DO NOT NEED TO KNOW THIS" 
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LESSONS LEARNED 


e BUILDING MENTAL MODEL OF DOC IS 
°o IMPORTANT 


o HARD 
o NOT WELL UNDERSTOOD 


e NEED TO THINK ABOUT TOOLS THAT SUPPORT 
BUILDING MENTAL MODELS OF DOCUMENTATION 


SUMMARY: SO WHAT? & 
WHAT NEXT? 


e SO WHAT? 
o 2 YEARS HAS YIELDED MUCH 


o CLOSE TO MAKING SPECIFIC PRESCRIPTIONS FOR 
"WHAT" & "WHEN" QUESTIONS 


0 DOCUMENTATION CAN BE IMPROVED AND USEFUL 
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WHAT NEXT? 


e REPLICATE AND EXTEND THE STUDIES 
e LOOK AT "WHEN" QUESTION IN MUCH MORE DETAIL 
e BUILD COMPUTER-BASED DOCUMENTATION TOOLS 


e SYSTEM SUGGESTS WHAT USER MIGHT NEED TO KNOW 
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MORE WHAT NEXT? 


e LOOK AT REUSABILITY 
e LIBRARIES OF ROUTINES 


e PROBLEM IS HOW TO DOCUMENT THEM? 
o TELL WHAT THE ROUTINE DOES 


o SAY WHAT IS "NON-STANDARD" ABOUT ROUTINE 


e MAKE STRUCTURE OF DOCUMENTATION EXPLICIT 


WE ARE OPTIMISTIC 


e METHODOLOGY IS DEVELOPED 
e INITIAL RESULTS 
e CLEAR DIRECTION FOR NEXT PHASES OF RESEARCH 


e INTEREST OF MANY COMMONITIES WITH DIVERGENT 
INTERESTS 
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PLANS 


O Install and evaluate components at Langley as 
they become available 


O Use ENCOMPASS prototype to examine more 
advanced features 


O Prototype will be used to examine the practical 
applications of SAGA 


1-27 


Cognitive-Based Analysis of 
Software Documentation! 
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TODAY’S TALK 


e THE PROBLEM OF DOCUMENTATION IN MAINTENANCE 
CONTEXT 


e SOME OF THE ISSUES WE HAVE STUDIED EMPIRICALLY 


e A TASTE OF THE RESULTS OF OUR STUDIES 
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THE PROBLEM WITH 
DOCUMENTATION 


e CONSTANTLY ENHANCING PROGRAMS 
e ENHANCER IS NOT ORIGINAL PROGRAMMER 


e BASIC PREMISE OF PROGRAMMERS: 
DON’T TRUST DOCUMENTATION 
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| OUR APPROACH: 
THE COGNITIVE PERSPECTIVE 


e THREE ISSUES IN DOCUMENTATION 
0 WHAT TO DOCUMENT? 


o HOW TO DOCUMENT? 
o WHEN TO PRESENT THE INFORMATION? 


eOUR ANSWERS TO 3 QUESTIONS ARE BASED ON 
COGNITIVE PRINCIPLES 
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OUR METHODOLOGY: 
(IN A NUTSHELL) 


e "YOU CAN OBSERVE A LOT BY JUST WATCHING." 
Yogi Berra 


e "YOU HAVE TO GO DOWN THE ROPE HAND-OVER- 


HAND." 
JPL Guru 
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2 AREAS OF STUDY AT JPL 


e AREA 1: EXAMINING THE WHAT QUESTION 


o PROGRAMMER’S USE OF CURRENT 
DOCUMENTATION 


o CAN WE IMPROVE IT? 


o STUDY DONE IN CONTEXT OF SMALL PROGRAM 
(300 LINES OF FORTRAN) 


o TASK: MAKE AN ENHANCEMENT 
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2 AREAS OF STUDY AT JPL 
(CONTINUED) 


e AREA 2: EXAMINING THE WHAT & WHEN QUESTIONS 


o PROGRAMMERS CONFRONT LARGE PROGRAM (60K 
LINES) 


01.5 FEET OF DOCUMENTATION 


o TASK: MAKE AN ENHANCEMENT 


AREA 1 STUDY: "WHAT" QUESTION 
PHASE I 


e METHODOLOGY: 


0 GIVE PROGRAMMERS SMALL PROGRAM + 
STANDARD DOCUMENTATION 


o ASKED THEM TO ENHANCE PROGRAM 
o VIDEOTAPED PROBLEM SOLVING BEHAVIOR 
o RECORDED "TALKING ALOUD" PROTOCOLS 


010 JPL PROFESSIONALS 
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RESULTS: "WHAT" QUESTION 
PHASE I 


e IDENTIFIED 2 PROGRAM STUDY STRATEGIES USED TO 
BUILD MENTAL MODEL OF PROGRAM 


o SYSTEMATIC: MENTAL SIMULATION USED TO SEE 
HOW WHOLE PROGRAM FITS TOGETHER BEFORE 
ATTEMPTING ENHANCEMENT 


o AS-NEEDED: GO FOR THE PATCH AS SOON AS 
POSSIBLE 


e IF ADOPT SYSTEMATIC STRATEGY ----> CORRECT 
PATCH 


e IF ADOPT AS-NEEDED STRATEGY ----> INCORRECT 
PATCH 


e NO EFFECT AT ALL OF PROGRAMMING EXPERIENCE!! 
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DISCUSSION: "WHAT" QUESTION 
| PHASE I 


e SMALL PROGRAM --- SYSTEMATIC STRATEGY POSSIBLE 
e BIG PROGRAM --- SYSTEMATIC STRATEGY IMPOSSIBLE 


e QUESTIONS: 


o WHAT INFORMATION DID SYSTEMATIC STRATEGY 
UNCOVER? 


o CAN THAT INFO BE PUT IN DOCUMENTATION? 


oWILL THAT INFO HELP THE £AS-NEEDED 
STRATEGY? 
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AREA 1 STUDY: "WHAT" QUESTION 
PHASE II 


e GOAL: FACILITATE AS-NEEDED STRATEGY 


e METHOD: PROVIDE KEY INFO IN DOCUMENTATION 


o CAUSAL INTERACTIONS AMONG DELOCALIZED 
PLANS 


e ANOTHER STUDY: 
NEW DOCUMENTATION vs. OLD DOCUMENTATION 


~@ PRELIMINARY RESULTS: 


oNEW DOC APPEARED TO HELP AS-NEEDED 
STRATEGY 


o SUBJECTS WITH MORE EXPERIENCE ESPECIALLY 
BENEFITTED 


o INTERESTING!! 
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| AREA 2 STUDY: _ 
"WHAT" & "WHEN" QUESTIONS 


e CAN WE PROVIDE KEY INFO WHEN IT IS NEEDED? 


e KEY INFO: GOALS -- WHAT IS PROGRAM/MODULE 
SUPPOSED TO DO? 


e PROVIDE KEY INFO UP FRONT --- NICELY LABELLED 


e LARGE PROGRAM CURRENTLY USED SUCCESSFULLY AT 
JPL (60K LINES) 


e LARGE DOCUMENTATION (1.5 FEET) 


METHODOLOGY: 


e CURRENT DOC vs. REVISED DOC 


e REVISION TRIED TO CLARIFY STRUCTURE OF 
DOCUMENTATION 


e 4 JPL PROGRAMMERS: 
(2 ON EACH FORM OF DOCUMENTATION) 


e ASK PROGRAMMERS TO MAKE ENHANCEMENT 


e ENHANCEMENT ACTUALLY REQUIRED CHANGING ONLY 
ONE MODULE | 
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RESULTS 


e OLD DOC: 2 HOURS TO FIND WHERE TO MAKE CHANGE 


e NEW DOC: 20 MINUTES TO FIND WHERE TO MAKE 


e BIG DIFFERENCE (BUT ONLY FOUR SUBJECTS ....) 
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e WE KNOW PROGRAMMERS BUILD MENTAL MODELS OF 
PROGRAMS 


e THE ISSUES HERE ARE: 


o PROGRAMMERS NEED TO BUILD MENTAL MODELS 
OF DOCUMENTATION 


o HOW CAN WE HELP THEM BUILD MENTAL MODELS 
OF DOCUMENTATION? 
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THE POINT IS: 


e FOR LARGE PROGRAMS, NEED CLEAR UNDERSTANDING 
OF STRUCTURE OF DOCUMENTATION 


e THAT IS A MENTAL MODEL 


eWE SAW THEM BUILD MENTAL MODELS ' OF 
DOCUMENTATION: 


o CURRENTLY RELEVANT: 
"I NEED TO KNOW THIS FOR WHAT YM DOING 
NOW" 


o POTENTIALLY RELEVANT: 
"I MIGHT NEED TO KNOW THIS FOR SOMETHING I 
DO LATER" 


o IRRELEVANT: 
"lI DO NOT NEED TO KNOW THIS" 


1-43 


LESSONS LEARNED 


e BUILDING MENTAL MODEL OF DOC IS 
o IMPORTANT 


o HARD 
o NOT WELL UNDERSTOOD 


e NEED TO THINK ABOUT TOOLS THAT SUPPORT 
BUILDING MENTAL MODELS OF DOCUMENTATION 


SUMMARY: SO WHAT? & 
WHAT NEXT? 


e SO WHAT? 
o 2 YEARS HAS YIELDED MUCH 


o CLOSE TO MAKING SPECIFIC PRESCRIPTIONS FOR 
"WHAT" & "WHEN" QUESTIONS 


°o DOCUMENTATION CAN BE IMPROVED AND USEFUL 
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WHAT NEXT? 


e REPLICATE AND EXTEND THE STUDIES 
e LOOK AT "WHEN" QUESTION IN MUCH MORE DETAIL 
e BUILD COMPUTER-BASED DOCUMENTATION TOOLS 


e SYSTEM SUGGESTS WHAT USER MIGHT NEED TO KNOW 
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MORE WHAT NEXT? 


e LOOK AT REUSABILITY 
e LIBRARIES OF ROUTINES 


e PROBLEM IS HOW TO DOCUMENT THEM? 
o TELL WHAT THE ROUTINE DOES 


o SAY WHAT IS "NON-STANDARD" ABOUT ROUTINE 


e MAKE STRUCTURE OF DOCUMENTATION EXPLICIT 


1-47 


a 


WE ARE OPTIMISTIC 


e METHODOLOGY IS DEVELOPED 
e INITIAL RESULTS 
e CLEAR DIRECTION FOR NEXT PHASES OF RESEARCH 


e INTEREST OF MANY COMMUNITIES WITH DIVERGENT 
INTERESTS 
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SOFTWARE ENGINEERING WITH REUSABLE COMPONENTS 
ATTACHMENT 


KEY TECHNOLOGY AREAS 


Component Technology Issues Examples: 


re) What 
e) What 
ve) What 


is the criteria for determining "reusability" of a component? 
reliability, maintainability, other "ility"™ measures/metrics 
encapsulation 

commonality with similar or different application areas 
documentation and other related software products 


are the behavorial/context/environmental factors? 
side effects or singularities 

target, word size, etc. constraints 

operating conditions constraints 


are attributes for determining the confidence factor 


(trust level) of a component? 


what other information do users need/want to know in 

order to "trust" a component -- related to cognitive 

process studies and the need to know some "why's" and 
"what's", not just "how's" 


are the guidelines for developing reusable components? 

use of data abstraction, generics, typing mechanisms 
encapsulation and packaging 

data management and other hardware/operating system 
considerations 

trade between generality and specificity 

information and related data products needed to support reuse 


Software System Technology Issues Examples: 


re) What 
when 


ro) What 


is the affect on the requirements and design phases 
component reuse is desired? 

requirements/design phases iteration and interaction 
affect on design phases when both requirements and parts 
are input 


approaches/techniques can be employed during the design 


phase to incorporate the proper balance of systems-driven 
and parts-driven strategies? 
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Learning the Behavior of Software Systems 
From Executable Specifications 
Christian Wild 


Associate Professor 
Old Dominion University 


Norfolk, VA 


* Supported by NASA Grant 1-439 


Objective 


Significantly Increase the Reliability and Robustness of Software Systems 


e Reliability - Development 


e Robustness - Operation 
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Statement of Problem 


Complexity increasing 

Criticality increasing 

First implies automation 

Second implies formal analysis 

which in turn implies formal description 


Orders of magnitude increase in reliability cannot be met by tradi- 


tional software engineering approaches. 


more than just integrated tools at the current level of sophitication. 


(not smart editors and command interpretors) 
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Current Software Development Paradigm 


Informal Validation 


Requirements 


Informal Verification 


Specfication 
Coding <———— Testing 


fn 


Tuning Maintenance 
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ro 


Automation Based Software Development Paradigm 


Informal 
Requirements 


Requirements 
| 7? Analysis 


Validation 


Maintenance 


l _ Formal! 


Specification 


Decisions/Rationale ————» Mechanica] 
> Optimization 


Tuning 


Concrete 
- Source 
Program 


e Slide adapted from ISI at USC 
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—— » Symbolic Execution 


Set of Behaviors 


y 


Generate Hypotheses 


Generalize Hypotheses 
Hypotheses of Behavior 
Theorem Prover 


L 


Assertions 


je 


Supporting Technologies 


Formal Specification Languages 
ee Verification 
Automatic Programming 

Rapid Prototyping 

Machine Learning 

Automated Reasoning 
Knowledge-Based Systems. 


Software Fault Tolerance 


Definitions 


Behavior - Result of applying a function 

— Specification - Implicitly defines oe 

Set of Behaviors - Explicitly defines behavior 

State - Sequence of function calls which generated a data object 


Canonical Form - Simplest sequence of function calls which exhibits 


equivalent behavior 
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Formal Specification for Queues 


Type Queue(Integer) 


SYNTAX 
Newq -> Queue 
Addq(Queue, Integer) -> Queue 
Deleteq(Queue) -> Queue 
Frontq(Queue) -> Integer U {error} 
Isemptyq(Queue) -> Boolean 

SEMANTICS 

For all q : Queue; i : integer Let 

1)  Isemptyq(Newaq) = True 

2)  Isemptyq(Addq(q,i)) = False 

3)  Frontq(Newq) = error 

4) — Frontq(Addq(q,i)) = If Isemptyq(q) then i 

else Frontq(q) 
5S)  Deleteq(Newq) = Newq 
6) Deleteq(Addq(q,i)) = If Isemptyq(q) then Newq 


else Addq(Deleteq(q),i) 


End Queue 


Examples of Behavior 


Generators: 
ADDQ(ADDQ(NEWQ,I,),1,) 


DELETEQ(ADDQ(ADDQ(NEWQ,I,),1,)) = ADDQ(NEWQ,L) 


Behaviors: 
ISEMPTY Q(DELETEQ(ADDQ(ADDQ(NEWQ, |), L))) = False 


FRONTQ(DELETEQ(ADDQ(ADDQ(NEWQ,I,),))) = 
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Learning Hypothesis of Behavior 


CURRENT FUNCTION 
STATE 


> RESULT 


Abstraction 


OBSERVABLE 
PROPERTY 


CLASSIFICATION HYPOTHESIS 


Hypotheses are of the form: 


FUNCTION(X) = RESULT ? A_F(X) e€ {PVs} 


Where ? 1s: 
IF - sufficient 
ONLY IF - necessary 


IFF - necessary and sufficient 
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Learning Algorithm 


—_—_—_——»,| Generate H, 


Example 


An 


Generate H, 
ontradicted? 


Y 


Generate H’, 


< ae for counterexample 
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Nomenclature 


e The AF is of the form #X, where X is A (D or N) if the AF counts 


the number of Addgs (Deletegs or Newgs) in the WFF. 
'e AFs on the canonical form will be designated by a adding a prime (’). 


e AFs which count events occurring before a key event are denoted by 


a subscript of pre/I,,, where J, is the item added at the key event. 


e For events occurring after the key event the subscript postil, is used. 


Deleteq(Addq(Addq(Newq./ ,),/ 2)) : (#A=2,#A'=1,#N=1,#A,,¢ 1,1 ,#A pos: =!) 


Isemptyq(Newgq) = T : (#N=1) 
H1,- Isemptyq(Q) = T if #N € {1} 
Isemptyq(Addq(Newg,/ ,)) = F: (#A’=1,#N=1,#A=1) 


DIFF : {#A’,#A} 
OUT : {#N} 


H2, Isemptyq(Q) = T if #A’ € {0} 
H2, Isemptyq(Q) = T only if #A’ € {0} 
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Isemptyq(Addq(Newgq,/ ,)) = F: (#A’=1,4N=1,#A=1) 
H3,) Isemptyq(Q) = F if #A’ member-of {1} 
H3,,) Isemptyq(Q) = F only if #A’ member-of {1} 


Isemptyq(Addq(Addq(Newg,/ ,),/)) = F: (#A’=2) 
H4,) Isemptyq(Q) = F if #A’ member-of {2} 
HS.) Isemptyq(Q) = F if #A’ member-of {1,2} 
H5,) Isemptyq(Q) = F only if #A’ member-of {1,2} 


H6) Isemptyq(Q) = F iff #A’ member-of {1..co} 


Program Synthesis for /semptyq 


IF #A’ = 0 THEN TRUE 
ELSE FALSE 


Demands which this behavior places on generators: 


NEWQ: Set #A’ to 0 
ADDQ: Increment #A’ by 1 
DELETEQ: Decrement #A’ by 1 
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yor 


More Complicated Result 


Raw Output: 


H10) Frontq(Q) = Ip if (#A*#Agggup,) © {(1.0),(2,1),3,2)yu0] 
H11) Frontq(Q) = ly if (#Dyogyt,s#A ores) € {(0,0),(1,1)} 
H12) Frontq(Q) = I, if (#A,#A’) € {(2,1),(3,2),(4,3),...} 


Generalized Output: 


H10"") Frontq(Q) = I, iff (#A’ - #Ajogy = 1) 
H11”) Frontq(Q) = Ip iff (#Dposiz, ~ #4’ pres, = 0) 
H12”) Frontq(Q) = I, iff (#A - #A’ = n-1) 
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<- Front Back -> 


\—— #A pen, | 

#Dpost/I, 
ee eee 
R— n=] 
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Oe 


Conclusions 


Machine Analysis of Executable Specifications: 

- — Synthesis 

- Automated Test Case Generation 

- Assertion Generation for Run-Time Monitoring 
- Feedback to Requirements Analysis 

Symbiotic Interaction: 

- Machine Learning 

- Symbolic Execution 


- Theorem Proving 


1-84 


(98 3NMf) c¥6 MYOS ISS 


SPx9] UOISNOH 
19}U9Q 9DedS UOSUYOLF ‘Gg UOPUAT 


VONEJISIUIWPY BDeEdS 
DUP SONNPUOJEY [PUONIPN 


VSVIN 


Glad JSP / NVWAOD AALS 
986l ‘SI AAGWAAON 


duV1I aVATD IV NOLSNOH AO ALISUAAINN 
ALIAILOV HOAVASAAY GAYOSNOdS IS 


» 


Sf JAVAYOLIIVIG LYOddNS NOISSIW VSVI} 


1-85 


NOISIAIG JUVM1IOS 14VUDID VS 


NOISSNOSIG GNY AXYYWWNS ‘9 

ALIAILIV GINNU1d °S 

SUSUL GAIHSITAVLSA “yy 

HI8VISIA JO SUANY TVNANID - YALNYHD SIDI “E 
LNANAZINNY AAILYNAdOOD SIDIN 40 NOILYWAOS ‘2 
ALIALLOY HIdVASAY THN (9861 AVW) SIDIN Jud ‘1 


INITLNO 


Sf ILVIOLIIVIG LYOddNS NOISSIW VSVNi-———— 


1-86 


NOISIAIG 38VM14OS 14VUDIDVES 


“ah 


YSHLIOOL ATASOTD JYOW WHOM CGINOHS ALISASAINN 
FHL ONY 43LN39 390dS SHL LYHL ALINMWWOD ISC AG NOILdaDudd ® 


TIIW Ydd¥d ONINNSWOD AWIL ONY ATLSOD © 
"ILE SNOILYDISILSNC JDANOS AWS ® 
G4agdadzaDKI SLIWNIT ONIGNNI ® 


1-87 


SLOVALNOD SHL ONISUNUW NI 3S08Y SWNA180dd ANUW ® 
NOILYUNIGHOOD TVHLNAD ON ® 

SJIGNLS JINSSITIZLNI TWIIIILAY © 

SAIGNLS ASVA VLUC © 

ALIS LSAIL VLIG FP ® 


IOHN LY SYSUL SNONAWNNN © 


ALIAILIV HINVISAY THN SIDI ddd 


Sf ILVAOIDIVIG LYOddNS NOISSIW VSVN}— 


NOISIAIOD JBVM1IOS 143VIDIDVES 


SNOISSIN SNOIYYA S.ISC/YSUN JO LINGNOD 
JHL NI GaIv¥INDAN ADOTONHIAL NOILYWHOINI GNU ONI.LNdNOD 
NI SLNAWNFJINVAGY ALUNTYUAT ONY AlddY ‘dOTSARC ‘AdILNIGI OL 
“1N09 ® 
SIOIN OLNI Ga0104 JYIM SLOVALNOD HDAVISIY IDHN ZAILIV ® 
AlNVAA GAMINIY 38 OL @ 
3861 AUW GSHSITEYLSA ®@ 


AWVU1 AVATD LY NOLSNOH 40 
ALISHFAINN AHL ONY ISC/VSUN N3SMLIG LNIWNIIHOY AAILYNSdOO) @ 


SSILIAILIVY AD4Od ASUL JO LNO MAYO LdaINOD SIJIN @ 


NOILY4dd009 
dO SUANY TWILNALOd JYOTdKA OL GAWNOS ADNOS MSYUL ® 


(OS¢ “Nd4dd1a9 AWYSC ANY 
TOHN “YASINULS WOL) ESET NI GINSIS SAHODIY .ANNSC ONY WOOL. ® 


SWILSAS NOILUNYOINI ONY ONILNdNOD HOA JLNLILSNI HDYVISAN FHL 


Sf JLVAOLIIVIG LYOddNS NOISSIW VSVIi--————_ 


1-88 


NOISIAIG 38VM14IOS 14VIDIIVS 


ONINIVUL ONY NOILYONGI 


1-89 


LNINISUNUW NOILUWNYOANI © 
SISATUNY TYDILSILYULS ONY TVILLYWAHLUW ad 
GWAILSAS LYSdHa GNU JONSSITISZLNI TIDISILEY © 
ONIAIINIONS JNYMLIOS ONY SWSLSAS YALNdWOD ° 


HDevISAaa JO SUANY TWAANAD 


Sf ILVYOLIIVIG LYOddNS NOISSIW VSVii-— 


a, 


NOISIAIG 2UVM1LIOS LIVUDIIVS 


SYSLNS0 VSVN ONV SJILISHYSAINN MYAHLO 
AYLSNGNI 

SYSLN3SO GNV SSLNLILSNI HOMNVISIAN 
OSr/VSVN 

JIxMV1 YV3S1D LV NOLSNOH 4O ALISMZAINN 


AAYLSNGNI 
SYALNAO 
SAILISYSAINNA 


1-90 


SINVdIOILYVd SIDI 


asw 


DSF 7Vso1D3NIG LyOdENS NOISsIW \VE\ yP\J—— LO 


SLSILNSIOS SLSILNSIDS SLNSGNLS 
YADVNVA SYSDVNVN ALINOVA 


SLSILN3IDS || SLN3GNLS || SYSANIDNS 
YSDVNVN 


AYULSNGNI 


ee eee ees es eee $1LO3frOud 
SHYOSNOdS HOUVaSSY 


a_i JSLLINNOD HOuVaS3Y a 
¥OLVNIGUOOD| 8 Teese 


ISf/VSVN 

aSLLINNOD 
ONINSALS 
aNV1 YV3T9-HN 


SY3SLN39D VSVN || OSf/VSYN INV YV3STO-HN 


ALISUSAINN || SLALILSNI 


<i) |. 


1-91 


JAILLINNOD 
ONIYSSLS 
JSf/VSVN 


SAUNLONYLS LNAWADVNVW 


SWSLSAS 
NOILVNYOSANI pue SNILNdNWOD 
10} 


SALNLILSNI HOYUVSSSY 


NOISIAID IVVM1IOS LIVYDIDVS 


SIILLINNOD 
GNU SGYvV0d GILVT3SN 8PY NO JNIS ONY YSUN OL LYOddNsS 


TUANUW SHASN GIaLSAL SWO 40 LNAWdO01dNId0 
ASUGULYG NOILUWHOINI GALY13ay PY 
SWALSAS YALNdWNOD G3ddaEdWI NO &PY ONIMSYWHINAG 


PPY OL 
(L4Y) TTSHS WILSAS LY3dKa LAV-JHI-dO-ALULS JO NOISHAANOD 


SLNINNOYIAND LYOddNS AWIL NN &PY NOs ISGOW 3NU7 
4419 AHL JO AdALOLOUd Ld3INOI-40-400Nd Y JO LNIWdOTSAIC 


(Q44S) YALNAD HIAVASTA ONINAINIONT AMYMLAOS ISC/YSYN LNIOC 
ALIS LSAL YVLIG PPY 


SNISSINIONA JNYVMLIOS ONY SWALSAS YSLNdWOD 
SYSUL GAHSITVLSA 


~OSW 
DSP 3VHOLDINIG LYOdENS NOISSIW \~E\I\J——— LO 


1-92 


NOISIAIG JUVMISOS L4VIIIIVAS 


AUYIW SATYYHD “AC *LIVLINOD THN 


A.LINQAWWOD SNILADWOD ANY FI¥dSONIY 
FHL AM ALIAILIV dOLY NI NOILUdINILIVd JAISNALHS ad 
1DHN GNU JSC LY AMVHNAIT TALWIS 40 LNAWHSIIGULSS © 


(LIM) NWYUSL JOVANALNI TUNA © 

aquyod epy ® 

dNOND ONIWHOM SIVD ® 

dN0d INIMYOM LNANNOWIANS JWIL NN PY ePYDIS © 


SJILLINWO) ONY STIINNOD FPY HSIH NO JINSNTIINI © 
SNOILULNIWIIGWI PPV 40 ONIMSUNHONSG 
SISATUNY LAS100L 3Sd¥ WAWININ © 


NOILYLS 390dS JHL 40d SNOILYIIdd¥ 
ONINNUND0Nd &PY NO JINSXSINOD TUNOILUNYSLNI LSdId © 
SYAH.LO % SYOLIVALNOD dOLY ‘SWNISOdWAS-ININ © 


SWNISOdWAS TNASSAIINS © 
ePpy SASOOH)D NOILULS - YAZAISNUUL ADOTONHISZL ®© 


SS LNAIWNHSITHWNODDU © 
9BGI - EBG6I GAIGNN4 ‘JLITWOD MON - ALIAILIV dOLY ° 


JLIS LSAL VLId SPY 


9Sf JLVYOLIIVIA LVOddNS NOISSIW VSVj— 


1-93 


SNOILVLINSSSYd 
SNNISOdWAS SNOILVLINANSIASNI YIUdNWOO Goa 
SLYOd3y 


3uUIS 1LS3L 
Vilage Opy 
IOHN/OSr YSVN 
4O LNSWHSNSVLS3 


VSL8L — SNOILVOISIDSdS OPV 
OSNINSSNIONS SJYVMLIOS 


3OVNONV) 
YAINdNOD JHL SV OPY 
SISOOHOD WVYSONd 4 > 


NOILVLS S30VdS 


SLSOO SYVMLIOS 
SNIVaeIdS IOYLNOD 
OL SLdSODNOO GOOG 


LNASNNOYMIANS LYOddNS 
SYVMLAOS NOILVLS 30vVdS 


NOISIAIG JBVMIIOS 14VIDIIVS 


AUYOW SATYVHOD “Yd =LOIVLNOD TOHN 


> 


SIILLINWO) ONY SGYYOd NO NOILULNSSAddaa NI YSUN LSISSY © 
LNIWNOWIANT LYOddNS JNYYMLAOS LYYV-JHL-dO-JLVLS ASVIMOHS © 


G4aLIaNId SY SHFHLO 

CI.LA) LIV ‘SMLYY ‘SdNOdD ONINNOM GALYTIN &PY 
SONINdS OGYYNOTOD LY GagLSAL Ids 

ALNLILSNI ONISSANIONS JYVMLIOS 


SAILNLILSNI ONY SHSLNID YSHLO HLIM NOILVITISIU © 
SANSSI ONILNdNOD GALNAINLSIG NO SISYHdWS YVINIILAYd © 


ALINNIIS WALSAS AALNdWOD 

AINYANSSY ALITYND ONY ALIITEVITIA WALSAS 
ONIYSZANIONA ONINIVLSAS 

NOILLYGITUA ONY NOILVIIATSaA 

ado) 

NOISAG 

SISAIUNY SLNIWNAXINOAY 


1-95 


‘NI HSISNUUL ADOIONHIAL WAS *° 
LNIOd ONILYVLS UV SY TSGOW Z9T2e GOd °® 


JIOAD AsI1 JMVMLIOS JMILNI YIAOCD OL SNIOI GNVdHA ®© 
dOLY ALIS LSAL YLIG FPY SHL OL NO MOTTO © 


NZLNID HIAVASIA ONISSINIONS JSAYYMLIOS TWHN/ISC YSUN 


Sf ILVYOLIIVIAG LYOddNS NOISSIW VsVi\j 


NOISIAIG JBVM1IOS 14VYDIDVES 


AUWIW SATHVH) “Yd -LIVLNOD TDHN @ 


WA1808d AALNdMWOD GI.LNEINLSIG 
dHL OL DAIDAdS SLNAWNAXINOAY ATYNOILINNA LADYVL/LSOH 
ALYIUNOILINAM 434d4NG WIS 

SNOWAC JILSONSVIC GNU ONILINSNOD 
ONISONGaG JTIOGWAS 

SLNANAIXINOAY TYNOILINNA NON 
JIVANSLNI JDVNONYT GNYWNWOD 


‘dO SUZYY FHL NI LNSWNOYIANS 
AWIL NNW °PY GAGNSLHA JHL 3dALOLONd GNU JZAIUNY @ 


JaYUMLIOS LNINISUNUW LSAL WO SSOND W104" 
LNAINNOSIAND AWIL NNd &PY W104 

WALSAS ONILYAIdO JWIL TVSY SLUY W108 
WALSAS LNANdOTSNIG 9PY 90/W104 

WYOMLIN SY LANYAHLA ATSHS AHL 4A0 
wOLIDIVL. SY SNOILYVLSYYOM OOOZAW 90 AZYHL 
LSOH SY OO0BAW 9d 


SSVGNOSAY GadLSAL SWC 
ONILSIKA JHL ONIZITILA G3GLSAL PY GALNGINLSIG HSITAVLSZ ® 


SLNIWNOMIAND LYOddNS JWIL NNS 
PPY 40d TH0OW ANVT YVATD AHL JO JdALOLOYd Ld3INOD-40-300Nd 


Sf JVyo13aNIG LyOdENS NOISSIW VsVNI————_ 


1-96 


NOISIAIG JUVM14OS LiVUDIIVdS 


AVMOW SATAVHD “Yd *LOVLNOD TOHN @ 
SPU NI LaY AaATIIG GNY dO13Ndd °2 ASUHA @ 


NU'ld LNIWIDUNUW 

INIGALOLOYNd TYILINI 

NSISSG AYYUNIWITS4d GNY SISATUNY 
dSIT JONFYIANI NI N3LLIOM ATLLNIYYND 


(NOILUYOddOD 
AINANAINI FHL JO LINGONd Y) LUY YO .1OOL OININOSYAY 
GILVUWOLNY. FHL JO °PY OL NOISHSANOD SHL NOISIG *1 JSUHd ®@ 


| PPY OL 
TOOL LNANdOTINIG WALSAS LYSdHa LYV-JHI-dO-JLULS ONILSING 
NU ONILYSANOD NI SJNODNSAO 3d OL SWA18ONd AHL ILYOILSAANI ® 


SPY OL LYY JO NOISHAANOD 


Sf ILVAOLIIVIG LYOddNS NOISSIW VSsVIi- 


sal. 


1-97 


NOISIAIG JUVM14OS 14V9DID VS 


LNAWNOMIANS JWILNNY @PY HISZLIOS HLIM &% MNA/NYU ® 
SLYY W10d / (NOILUINWA YMYH W108) OOOBAW 9G ® 
Nid / KUAOUDIN ® 


SONIGNIA NO LdOds4y 
GNU SWHYWHINSG JHL NNY TANNOSH3d 10S) WOYd JINULSISSY HLIM ® 


1-98 


SNUEI0Nd WHYWHONAG JO LIS YU LIAITIOD GNY dO1SA3a ® 


SLNAINNOUIANT AWNIL-NNY FPY ONY 
SWALSAS LNANdOTSAAG &PY 40 ALIUNLYUW ONY ALITUND JHL SSISSY e@ 


rm a SSS SS sp es) 


SWALSAS YALNdWOD G3ddaEWA NO &PY ONIWYYWHINIG 


5Sf¢ ILVVYOIDIVIAG LUOddNS NOISSIW VSVIN-——— 


NOISIAIG JBVM1IOS 14VBIIIVAS 


SO¥WA1 ANOHLNY “Ad *LOVLNOD TOHN 
SLNANOdWOD *°PY JTEY¥SNIA 30 NOILdIdISAG 


aasn ONIZd SI 
SPY ANIJHM SLIFZCONd LNAXAND NO NOILYUWYOINI GNVY SNOLLdId9Sad 


Sudd¥d ONY SW00E GILYUTFY FPY 
Sa2gNOSAA ONINIVAL GNY NOLLYDNGI 


ITEU TIYVAY 
SLUNYOI LYOdad GNY SNNSW JAISNALHS - ATONSINd YaSN ATHSIH 


JNVAINIUW TOHN YO NID Y NO SSHLID GILYIOT 
qasvd aTIVva0 


ALINAWWOD ONISSANISNA JYYUMLIOS/&PY 
JHL NI 11Y¥ OL JIGUTIIVAY ALITILN ANIT-NO NU 3d OL 


ASYEGULYUG NOILYNYOANI GALU1Sa SPU 


9Sf ILVYO1LIIVIG LYOddNS NOISSIW VSN 


1-99 


NOISIAIG JUVM1IOS LIVVDIDVS 


AUYOW SATHVHD “YC *-LOVLNOD TOHN ® 


LNINASUNUW ASUEULUG 
LNAWJSUNUW S14 

NOILNAINLSIG GNU NOLLISINOIY VLUG 
SNOILYDJINAWWOD AHOMLAIN 


‘NO SNOILIIS dOd SNOISIASY JIdAIDadS AGINOad *® 
SISATUNY T1¥-Hdh0 JGINOdd ® 


AATLIAdSddd ONISSANIONS JMYVMLAOS ® 
JAILLIAdSadd @PY ® 


TYUNNUW SH3SN GaGLSAL ONILSIHS JO SISATUNY ONY 3NDILIYD ® 


TUNNUW SHASN GsaAGLSAL SWA 40 LNAWdO TSAI 


Sf JAVAOLDIVIG LYOddNS NOISSIW VSVN]-————_ 


1-100 


NOISIAIO JBVM1IOS L4IVBDIIVES 


AYWOW SAITYVHD “Ad *LOIVLNOD THN © 


6# dNOdD ONIWNOM &PY OSI 
JALLINWOD SGHVANYLS ISNY &PY 
dNOdD ONIMHOM ONIMNOM AWILNAY &PY 
SdNOND ONINVYOM (SIYD) LIS JIVANALNI JSdV¥ NOWNOD 
WUSL JIVJNALNI TUNA 
Guyod ePy 


SGNOILUZINYDYO ONIMOTIOS HLIM JIVANZLNI © 


WYNd0dd NOILYLS JIVdS 

JHL JO LSANSLNI LS34 3HL LO91S9Y TIM AZHL LYHL 0S SaLI10d 

GNY ‘SANITZGIND ‘SCHYGNYLS ©PY ONIAIONAS LNULOSdWI JHL 
JONANTANI ‘ILUINdONddY AYSHM ‘ONY ONVLSYSGNN OL ‘dAILIaCEO © 


area ae a a 


LYOddNS 3LIS WUAL LSAL VLIG SPY 


Sf ILVAYOLIIVIG LYOddNS NOISSIW VSVN}— 


1-101 


NOISIAIG JBVM1IIOS LIVIDIIDVS 


LNINISUNUW ASVEYULYC TYDISOLSIH 
AMNLINULS WYOMLAN OIGNY 
SNOILYYACISNOD 

NOILLYNNISEO ONIGNTIONI ONIGHOITY GNY ONINOLINOW 
ONILNIOd VaAWNYD AL 

ONILNIOd GNY ONIMIVEL UNNILNY 


FJONADITIALNI THIDISILYY - SHSUL GAHSITEVLSS 


Sf 3VAO1DINIG LYOGENS NOISSIW \~O\ \J-———— 


Calas “AL “AG *LOVLNOD TOHN 


WILSAS ONIMDVUYL ONY SNOILYIINNWNOD 
NOILULS 39UdS JHL 40 NOILYYANDIANOIAY ANY NOLLYANSIINOD 
40d SANDINHIAL WALSAS LYadKka JO JSN AHL AZSATUNY 


I 3SUHd ‘AGNLS WALSAS LYddHd ONIWIVUL ONY NOLLVIINAWWOD 


1-102 


NOISIAIO JBVMI1IOS LIVIIIDVES 


NYUWd33dad NNATD “M0 -LOIYVLNOD TOHN ® 


GiLIZNIG SY SONINIAIO JSUNOD MAN dOTANAG *° 


ALINQWWO) JSC SHL OL ONINIVSL SNINZAINION JaVMLAOS 
ONINAAITIA YOA NUId JIOALYYLS Y NIVLNIUW ONY dOTaAdd © 


3SUGULYUGC JHL NI SNOILdO ONINIVAL 
JHL YOd SISATUNY LIAINAGLSOD Y NIVLINIUW ONY dOTaNaGd ° 


ONINAANIONA JYYMLIOS NI SGAIN ONINIVAL 
NOLIVULNOI/ISC JO ATANNS LIYYYW VY HSITGNd GNY WaOddad © 


KITUNOILUN ATE TIVAY ONINASNIONA JHVMLAOS ANY &PY 
NI SQINNOSIY LYAdHA JO JSYAVLUC VY NIVLINIVW ONY HSITEVLSA ° 


ATTUNOILUN ATGUTIVAY ONINIVSEL SPY GNY 
ONIAZINIONA ANYM.L4OS 40 ASYVEULYG Y NIVLNIUW ONY HSII@ULS4 ba 


(AUC 
JTYH Y ‘Hdd¥) ONISSZANIONS AYYMLIOS GNY &PY NO SHSDUNUW 
IAAI NdddN NOd ASHNOD 3AdALOLOUd ¥ LNAWATdWI ONY NOISAG © 


ONINIVUL °PY GNU ONISSSNIONS JaUMLAOS ° 


ONINIVAL GNY NOILYINGA - SASVL GIHSTISVULSA 


9Sf MVAO1DINIG 1vOdENS NOISSIW \~O\\-—_ 


1-103 


aw 


NOISIAIG JUVMIIOS LIVAYDIIVES 


1-104 


AIAUNS ALIMA¥d¥) HILNGNOD YANY BY YYVATD «@ 
WYUUD0Nd LNAWNdO19N30 TIGON LAYAYWN Buds ® 


LNIWADYNUW NOILUWHOINI - SYSUL GSHSITAY.LSS 


3Sf JAVAYOLIIVIG LYOddNS NOISSIW VSVINi-———— 


NOISIAIO IUVMLIOS 1LIVVDIDVS 


dOHSIG WALdd “Yd *LIVLNOD THN 


SLAIYIVUW 3IVdS 
NO YLYUC ONIAVH SADINNSS NOILYWNHOANI YAHLO HLIM ONIDVINALNI 


SLIYSYW JIVdS JNNLNA NO YLYUG ONILIATIOD 404 WAOMIWYAS 
SLAYYYW JIVdS A4OD AHL 4O TSGOW JINONODS 
NOILINISS0 LONGOYd AMUNIWI19ad 


LAWIYW 3IvdS 
ONIOSNSWA SHL SHOLINOW HOIHM JDIAXAS NOILYWAOINI NY AGIAOdd 


WYUYND0Nd LNAWdOTSAIG TAGOW LAIWYYW JIVdS 


DSP UVYoO1DINIG 1vOdENS NOISSIW \ yO) PP\J-———_ 


1-105 


NOISIAIO JUVMLIOS L4VNDIDVS 


NOLSNOH NI19 “Yd -LOVLNOD THN ®@ 


SONIGNIA JHL JO ISVEGULYC YU NIVLNIUW ONY HSII€YLST ® 


SNOISNAWIC HONVASAY GNY TUNOILNLILSNI 
TANNOS&dd 
JaUMLAOS 
JaUMadUH 


‘JasN0OD Suady ®@ 
SAILIMIGUdV) AILNdNOD VAYY IMV1 YYS1D JO SNSN3D LONGNOD ® 


AANGNS ALIMIGVdY) YALNdWOD YVANY AMV HVAT) 


Sf ILVYOLDIVIAG LUOddNS NOISSIW VSN 


1~106 


NOISIAIG JUVMIIOS 1IVADIIVES 


AUWOIW SATHVHD “Yd *LIVLNOD TIHN 
SYHOMLIN WILNdNOD SNYOEIIVdS HOS SANSSI ALINIAS 
epy NI SWALSAS LYddxd JO SISATUNY HSHLENS 
STOOL NOILYIISINIA JYVMLIOS GILYWOLAY 

ONILSSL &PY NI LNSNZOUNUW NOLLYUWYOANI ITIOGWAS 


ONINZINIONA JXYMLAOS ONY SWALSAS YALNdWOD ° 


NOLSNOH N319 “Yd *LOVLNOD THN 
- IOMLNO? JONLILLY GNU LNSWS9UNUW WALNAWOW NOILYULS JIUdS © 


SISATUNY TVDILSILYLS ONY TYDILUNJHLUW ® 


d0OHSI@ 
YILId “NC -LIVLNOD TOHN - ASYAYLYG SAGVOTAYd TYIJNSWWOD ° 


LNINSSUNUW NOILYWHOANI © 

NOLSNOH NNITS “dd 

SLJULNOD TOHN - SWILSAS 39¥dS NI TOYLNOD ONY NOILISLAG 
JaNTI¥s OL ANOZHL GILV19N GNY SLIS AZZNd JO NOILYITIddv © 
NI9UZ4 AYUSL “YO *LIVLNOD TDHN - ONINNY'Id HLVd LOGOd © 

NISVS4 

AUYAL “NG *LIVLNOD TOHN - SNOILYDIIdd¥ JIVdS 40d SWILSAS 
NOISIA LSSL ONY ALYVINWIS OL G3GLSAL SDIHdVHD HALNdWOD ® 


SJONAVITIAZLNI TWIDILIY © 


S¥SUL GINNV Id 


59Sf JAVYOLDIVIG LYOddNS NOISSIW VSVNI- 


1-107 


NOISIAIG IBVMIIOS 14V¥YDIDVdS 


INONLS NIVASY LSNW HINVISIY OL LNINLINWOD S.YSUN 
ASOTONHIAL INILNAdWOD NI JINI1199KF NIVLINIUW GNU JAZIHIY OL ® 


ANUM ADSOTONHIZL LSALY1 ONISN LNOGY SNYSINOD ®@ 
JNOG €0£ ONILLSS OL SLAIHS 3uNSSIYd ® 


LNIWdOT4A30 OLNI SAAOW 
NOILYLS GNY SNLULS TYUNOILYYIdO OL SNYNLIY JILLNHS SY ® 


SWUE90dd NOILULS ONY JTLLAHS 3HL NI GuYyUMaos 
SNIAOW JO LIZIdI JHL 3& TIM LYHM ‘NOILSIND OIG 3NO ® 


JUUMadaYH 
SNILNdWOD JO ALITIGUdYD ONISUAYINI ATIVIILYUNYUNG ® 


SLISGNG LIFCOUd 
JO JOVLNADUdd ONISUSMINI YIAT ONIGHOSEY YORU ANUMLIOS e@ 


HOIH NIVWIY ‘TIM 
SWALSAS NOILYWYOINI GNU ONILNdWOD NI HOYVSSIY AOd GAIN AHL ® 


JSC LY ALIAILIVY HOMVISIA ONIHSITEYLSA 40 GOHLAW 3AILI9I43 
NU dd OL N3AOdd SUH LNIWIINOY FAILYYId00) SIDNY FHL ® 


NOISSNISIG GNY AYYWNWNS 


3Sf JLVYOLIIVIG LYOddNS NOISSIW VSVINi-—— 


1-108 


ICLASS 
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ICLASS RESEARCH ACTIVITIES 


Abraham Belford 


Baner; €@/ Parallel Distributed Camp bell 

Architectures Algorithms r 

Jauidson & Algorithms & Systems Gea 

Fuchs Kamin 

| Harandc 
4 ger Len 
Patel Liu 
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DISTRIBUTED SYSTEMS 


On @ 
Dis. 
DBMS 

@ 

On ; 
Dist. 

OS e 
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On @ 

Comm. 


Subne 


ICLASS overview 


Reliable, Distributed Data. Base 
Management Systems (Belford) 


Distributed File System for A 
Network of Workstations (Iyer) 


Adaptive Operating System for 
Message Passing Machines (Reed) 


Process Migration (Lu) 


Distributed, Macro Data Flow 
Architecture (Leu) 


Integrated Communication 


Networks (Reed) 


November,17,1986 
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SOFTWARES AND 
SOFTWARE ENGINEERING 


e <A Type System for A Functional 
Programming Language (Campbell) 


e Environments for Parallel Computation (Gear) 


e A Program Development System (Kamin) 
e Abstract, Executable Specification (Kamin) 
e A Decentralized Debugging Service (Lin) 


e Software Engineering Data Base and 
Project Management Support Systems 
(Belford, Harandi, Liu) 
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HIGH PERFORMANCE AND 
HIGHLY AVAILABLE 
DISTRIBUTED SYSTEMS 


e Distributed Task Assignments 
e Load Balancing Algorithms 

e Dynamic Control Structures 

e Reconfiguration Schemes 

e Process Migration 


e Objected—Oriented, Data Flow Architecture 


ICLASS overview November,17,1986 
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Three Implementation Projects 
to build 
DISTRIBUTED SYSTEMS 


e DROLL, A Distributed Testbed for 
DDBMS Algorithms and Protocols. 


e PICASSO, A Adaptive Distributed 
Operating System 


e MENTAT, A Object-Oriented, Macro 
Data Flow System 


ICLASS overview =e November,17,1986 


DTROLL, A Test Bed 


lo evaluate protocols for 


e Concurrency Control 


- Failure detection and recovery 
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The Cornerstones of 


Picasso 


Portability 


Process 


Adaptive 
Distribution 


Routing 
Ar 


Systematic 


ow 


Programming 
Environments 


chitecture 


Topology 


ICLASS overview 
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November, 17,1986 


Picasso Will Provide 


e A frame-work for testing and evaluating message 
routing & load sharing methods 


e An open, layered, and expandable basis for 
operating system design and experimentation 


e A portable, efficient environment for parallel algo- 
rithm development 


Only by advancing the state of the art in programming 
environments for message passing computers can we 
realize the promise of effective large—scale parallelism. 


Using adaptive routing, dynamic load sharing and 
a consistent system representation, Picasso will 
engender solutions which harness parallelism while 
maintaining clarity and reliability. 
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MENTAT 
An Objected—Oriented, Data Flow Machine 
OBJECTIVES 


e To provide an environment conducive to 
distributed software development 
and effectively supports software reuse 


e To develop a high performance distributed 
system in which the degree of parallelism 
is maximized 
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Distributed Macro Dataf low Mackine 
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MeCFIACE 

EP Landicr © 
| Ade 


‘Components of MENTAT : 
¢ Actor - Objects 
e foken or messages 
; Programming Languages : 
C++ and Ada 
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A Macro Data Flow Machine 
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Storage unit unit unit 
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Summary of ICLASS Activities 


Systems and Software 
Engineering 


™ adaptive Dos Environments for Pa. Pro. 
A Macro dala flow 

architecture _- Abstract, executable 
specifi cation 


| A type system for afP 


Pro CESS mag ya tion 
| A program de velopment 


) system 
A decentralised debugging 
| service 
Distributed file | 
o a for | 
networks of a) of E 
: | ware €ng.neeren 
workstations ; data jee se a 
Reliable, distribu ted Project management 


DBMS | Support systems 
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OVERVIEW OF ICLASS RESEARCH: 
RELIABLE AND PARALLEL COMPUTING 


R. lyer 


Computer System Group 
Coordinated Science Laboratory 
University of Illinois at Urbana-Champaign 
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ICLASS ACTIVITIES IN RELIABLE AND 
PARALLEL COMPUTING 


@ 6 Faculty, 10 students 


@ Research Areas 
- Reliable Computing 
- Parallel Processing 
@ Interaction with NASA Centers 


- Student/Faculty visits to NASA facilities 
- Joint Research with NASA-Ames, JPL 


- Interactions with NASA Langley 


@e Other Activities 


1-124 


RELIABLE AND FAULT TOLERANT COMPUTING 
e Automatic Recognition of Failure Symptoms 


O Real time prediction of major system problems 
based on low-level error/recovery symptoms 


0) Prediction based on learning from observed 
behavior 


® Structure Based Error Detection 
0 Detection of major software problems 


) Detection of hardware failures affecting 
software integrity 


@ Algorithm-Based Fault Tolerance 


O Takes advantage of unique features of the 
algorithm 


0 Cost effective for specific application e.g. signal 
processing, Matrix Manipulations 
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RELIABLE AND FAULT TOLERANT COMPUTING 
@ Fault Latency: Experimental Study 


0 Simulation based study using real workload 
data 


0) Accurate evaluation of fault latency 
distributions 


0 Latency distributions valuable for accurate 
reliability prediction and estimation of 
multiple failures 
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PARALLEL PROCESSING - APPLICATIONS 


@ Image Processing 
0 Low level operations e.g. convolution, filtering 


0 High level operations e.g., connected 
components 


0 Unique feature is handling both in real time 


@ Design Automation 
0 Standard Cell Placement 
O Wire Routing 


O Unique feature is use of hypercube to give 
large speedup instead of special purpose CAD 
accelerators 


@ AI Algorithms and Software 


0) Development of heuristic rules to guide 
parallel run-time search for LISP and 
PROLOG programs 


0 Investigation of architectures to support 
parallel search techniques 
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PARALLEL PROCESSING 
e Architecture 


O Reduction in communication overhead 
0 Efficient use of local memory 
0 Study of memory referencing characteristics 
for individual locations 
@ Measurement-based Evaluation 
O Concurrency Measurements — 
- Hardware Monitoring 
- Software Instrumentation 


0 Relating concurrent program behavior to 
system resource usage 


AUTOMATIC RECOGNITION OF FAILURE SYMPTOMS 


R. K. Iyer, L. T. Young and V. Sridhar 
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OBJECTIVES SS aa eT ETT 


@ Recognize onset of persistent system problems 
based on observed relationships between low level 
recoverable errors 


e Differentiate between transients and intermittents 


® Quantify the strength of the captured relationships 
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BACKGROUND/MOTIVATION 


@ Early recognition of symptoms of persistent errors 
usually not possible 


@ Causes usually complex—may affect different parts 
of a system 


@ Detection commonly occurs as many isolated 
incidents 


@ Incorrect diagnosis leads to improper recovery 
management —-> affects system integrity 


-@ To be effective, the system must examine 
seemingly unrelated error events for possible 
relationships 
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SYMPTOM RECOGNITION 


1. Clustering of identical errors 


2. Identification of sudden rise in failure rate— 
GROUPING 


3. Identification of EVENTS—"Similar" groups 
4. Identification of SUPER EVENTS—‘related" events 


>. Quantification of the strength of inter-record 
relationships 
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V ATION OF FA 
e Probabilistic Validation 


P(A ,)*P(A 2)*...8P (A, )< P(A) Ad, ++ A) 


P(A,)*P(A>)...*P(A, ) 


Strength (S) = —7,4—,5— oe PALER 


@ Group Level Validation 
0 Complete Analysis 
O Subset-Based Analysis 


@ Event-Level Validation 
0 Inter-Group Analysis 


® Super Events 
C) Inter-Event Analysis 
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SENG F 5  e ece eea 


i. Demonstrated a technique for fault isolation 


2. Allows resolution between independent and 
dependent causes, transients and intermittents 


3. Estimates strength of relationship among 
dependent failures (useful in prediction) 


4. Can evaluate effectiveness of new diagnostic 
techniques : 
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FUTURE RESEARCH 


@ Current results show that real-time diagnosis is 
feasible 


@ Develop strategies for on-line diagnosis and 
reconfiguration for complex multi-computer 
systems 


@ Perform hardware and software error injection 
experiments on network of workstations 


@ Extension to symbolic architectures 


@ Investigate feasibility of on-line software “repair” 
routines 
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«- CASIS is Stanford's Center for AerOnautics and Space 
Information Sciences 


¢ CASIS was founded in March, 1983 with the support of a block 
grant from NASA's Office of Aeronautics and Space Technology 


¢ CASIS was founded as a multi-disciplinary, cross-departmental 
research structure which would provide faculty and students with 
an opportunity to participate in a variety of space-related projects 
relating to activities of the U.S. civil space program 


¢ CASIS includes 13 Stanford faculty, 9 professional 
research staff, 31 graduate students, and 6 undergraduates 


¢ The CASIS administrative offices, the central computer facilities, 

and the CASIS Experiment Laboratory are located in Durand Building. 
Participating projects are located in various CSD and EE buildings on 
campus 
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‘'CASIS Governance 


¢ CASIS is governed under a charter approved by the 
Stanford School of Engineering and the Provost 
of the University 


- The overall direction of the center is provided by the 
Director, Prof. Peter M. Banks. 


- Day to day operations are under the direction of the 
Associate Director, Dr. Michael J. Wiskerchen. 


¢ Policy decisions for CASIS are reviewed by the CASIS 
project investigators 


- Progress of research projects and associated budgets are 
monitored by the Director in collaboration with individual 
research project leaders 


¢« The practical responsibility for research work lies in the 
hands of the research leaders 


- The Director reports to the Associate Dean for Research in the 
School of Engineering 
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M. J. Wiskerchen — STARLAB/SEL 


CASIS 


Center for Aeronautics and Space Information Sciences 
NASA OAST HQ block grant in information sciences 
Advanced information sciences technology research 

Core technology for ” TELESCIENCE” applications research 


Advanced technology for Shuttle and Space Station ap- 
plications 


1-138 


STANFORD RESOURCES 


Academic Departments 


Aeronautics & Astronautics 
Applied Physics 
Biology 
Computer Science 
Electrical Engineering 
Psychology 
Physics 


Laboratories & Centers 


Center for Aeronautics and 
Space Information Sciences 


Center for Integrated Systems 
Center for Space Science and Astrophysics 
Computer Systems Laboratory 
Information Systems Laboratory 


Stanford Electronics Laboratory 


Space, Telecommunications 
and Radioscience Laboratory 


Stanford Services 


Stanford Instructional 
Television Network 


information Technical 
Services 
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M. J. Wiskerchen — STARLAB/SEL 


Center for Aeronautics and Spaee Information Sciences 


CASIS 


e Concurrency Studies 


o Researchers: M. Flynn, S. Owicki, S. Lunstrom - 5 
students 


o Performance of Highly-Concurrent Systems 
o Models of Parallel Programs 


o Highly Reliable Concurrent Programs 


e Network Graphics and User Interface Architecture 
o Researchers: Ix. Lantz - 4 students 
o Virtual Graphics Terminal Service 


o User interface architecture: Terminal management 
- Command specification and response handling - 
application specific interaction - multi-application 
management. 
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CURRENT CASIS RESEARCH 


Studies in Computer Concurrency-- Prof. M. J. Flynn 
High Speed Local Area Networks-- Prof. F. A. Tobagi 


High Performance VLSI Signal Processors-- 
Prof. A.M. Peterson 


Parallel Computing Arrays for Signal Processing-- 
Prof. T. Kailath 


Satellite Communications for Space Science Data 
Systems-- Prof. B.B. Lusignan 


Network Graphics and User Interface Architecture-- 
Prof. K.A. Lantz 


Large Volume Database Management-- 
Prof. G. Wiederhold 


Rapid Image Retrieval for Remote Sensing Data-- 
Prof. P.M. Banks 


Advanced Video Systems and Robotic Vision Systems 
for Scientific Analysis-- Dr. M.J. Wiskerchen 


Highly Concurrent Systems-- Prof. S.F. Lunstrom 


Reliable Concurrent Programs-- Prof. S.S. Owicki 
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M. J. Wiskerchen — STARLAB/SEL 


Center for Acronautics and Space Information Sciences 
CASIS . 
e High Speed Local Area Networks 
o Researchers: F. Tobagi, M. Mahric - 4 students 
o Topological Design of Fiber Optics LANs 
o Study of Media Access Protocols 
o Design and Implementation of the Network Interface 


o EXNPRESSNET implementation 


e Telecommunications Research 
o Researchers: B. Lusignan - 5 students 
o Efficiency modeling of satellite digital transmission 
o Study of new modulation techniques 


o C-\MOS integrated circuit design for radio-channel 
equipment 


o Efficiency models for fiber-optic digital networks 


o Optimization modeling for digital communications 
components 


o Digital Telecommunications switch development 
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M. J. Wiskerchen — STARLAB/SEL 


Center for Acronautics and Space Information Sciences 


CASIS 


e Parallel Computing Arrays for Signal Processing 
o Researchers: T. Kailath - 2 students 


o Parallel Algorithms and Architectures for Kalman 
Filtering 
o Schur vs. Levinson Algorithms for Stationary and 
Nonstationary Processes in Data Communications 
e Advanced Concepts for Remote Space Science Operations 


o Researchers: P. Banks, P. Williamson, R. Clauer, 
\{. Wiskerchen - 6 students 


o Telescience Research for Shuttle and Space Station 
Systems 


o Distributed Computer Graphics Networks 
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M. J. Wiskerchen — STARLAB/SEL 


Center for Aeronautics and Space Information Sciences 


CASIS 


e High Performance Signal Processors 
o Researchers: A. Peterson, I Linscott - 3 students 


o PROLOG language as a processor description tool 
and VLSI CAD systems 


o High performance architectures with relational process- 
ing 
o Real time parallel processing - Scheduling Theory 
approach 
o Optimization of pipelined processor using linear program- 
ming 
e DataBase Management Architectures 


o Researchers: G. Wiederhold, P. Rathman, H. Waquar 
- { students 


o Database design and operation methods and algorithms 


o Optical storage technology 


_ New CASIS Research Topics 


1. Color Stereoscopic Video Systems-- Prof. P.M. Banks, EE 
2. Speech Recognition and Analysis-- Prof. R. M. Gray, EE 

3. VLSI Tactile Sensors-- Dr. P.W. Barth, CIS © 
4. 


ADA Development for Space Systems-- 
Prof. D. C. Luckham, EE 


5. Distributed Network Architectures for A.!I. Work Stations 
--Dr. T.C. Rindfleish, CSD 


6. Human Factors for Space Experiment Operations-- Dr. M. 
J. Wiskerchen, EE 
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Stanford University Network for Space Telescience Applications Research 
SUNSTAR PROGRAM 


M. J. Wiskerchen — STARLAB/SEL 


VALUE OF TELESCIENCE 


e ENHANCES PRODUCTIVITY OF REMOTE OPERATIONS 
o Gives better use of local and remote human resources 
o Reduces mistakes | 


o Provides a capability to quickly investigate new or 
unexpected phenomena 


° SHARPENS FOCUS OF SPACE RESEARCH OPERATIONS 
¢ PROVIDES COORDINATION OF EXPENSIVE RESOURCES 
¢ PROVIDES DESIGN GOALS FOR SYSTEM PLANNERS 


e GIVES FOCUS TO NEW TECHNICAL NEEDS TO 
SUPPORT SCIENTIFIC RESEARCH OPERATIONS 
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Technical Challenges for Telescience 


Restricted bandwidth in telecommuncation channels 


¢ Need for information compression 

¢ Dynamic channel selection based on useage models 
¢ New modes of communication (e.g., electro-optics) - 
¢ Use of object coded definitions for graphics 


Finite signal propagation time 


¢ Look-ahead capabilities for experiments and operations 
¢ Autonomous operations | 
¢ Advanced local simulation of remote system behavior 


Integrated information acquisition and dissemination 


¢ Digital data to include images, voice, computer 

¢ Development of appropriate packet techniques 

¢ Main link vs. local and remote distribution, capture and 
processing 


Spatial diversity of user centers for single experiment sites 


Control and command models 

Sharing of current information 

Segregation of returning information to local addressees 
Standard interfaces and access protocols 


Human interactions 


¢ Integration of voice, image and computer information 
for experiment control 

¢ Optimization of cognition for “adaptive” science 

« Balance between automatic sequences and timely 
direct control 

¢ The value of local simulated and time-delayed experiment 
images 


1-150 


6. Tool development 
¢ Voice coding and synthesis 
¢ Voice recognition and computer interaction 
¢ Simulation 3-d graphics 
¢ Stereoscopic video 
¢ High definition video 
¢ Knowledge-based operations planning 
¢ A.l. for remote instruments and support equipment 
¢ A.l. for local site system configuration and operation 


¢ Hardware support for network graphics 
¢ High-bandwidth local area network for mixed mode data 


¢ Query language database management 
7. Cost issues 
¢ System costs must match user needs 


8. Reliability 


¢ Needs will vary according to the telecommunications 
channels used and the type of project 
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TELESCIENCE 


NEW ENGINEERING PHILOSOPHY 


A NEW, UNIFYING CONCEPT BASED ON THE NEED TO IMPROVE 
THE WAY REMOTE RESEARCH OPERATIONS ARE CONDUCTED 
IN SPACE AND IN A TERRESTRIAL ENVIRONMENT 


WILL PROVIDE A DESIGN GOAL FOR SPACE STATION 
TECHNICAL DEVELOPMENTS 


HAS STRONG TIES TO AUTOMATION, ROBOTICS, EXPERT 
SYSTEMS, COMPUTER VISION, AND OTHER TOPICS RELATED 
TO KNOWLEDGE-BASED ENGINEERING 


IS AT THE FOREFRONT OF NEW APPLICATIONS INVOLVING 
HUMAN FACTORS ENGINEERING 


PROVIDES A MECHANISM FOR UNIVERSITIES, INDUSTRY AND 
GOVERNMENT TO WORK TOGETHER ON RESEARCH AND 
TECHNOLOGY PROGRAMS 


PROMOTES THE USE OF RAPID PROTOTYPING CONCEPTS AND 
TESTBEDS TO DEVELOP FUNCTIONAL SYSTEM DESIGNS 


PROVIDES NEW OPPORTUNITIES FOR UNIVERSITY-BASED 
RESEARCH AND PILOTS 
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UNIVERSITY CONSORTIUM FOR SPACE E 


STATION ited anaedeniaionic 


PURPOSE: 


APPROACH: 


PROCESS: 


PROVIDE A MEANS FOR THE UNIVERSITY SPACE SCIENCE 
COMMUNITY TO INVESTIGATE, DEVELOP AND VALIDATE 
FUNCTIONAL REQUIREMENTS FOR THE DESIGN OF THE 


SPACE STATION 


DO EXPERIMENTS WITH USERS ON PROTOTYPES OR TEST- 
BEDS AND EXTRACT DATA FOR EVALUATION OR TRADE- 
OFF ANALYSIS 


REQUIRES A TEAM INCLUDING EXPERIMENT EXPERTS, 
SYSTEM ENGINEERS, USER ANALYSTS AND PROTOTYPERS 


FRAMEWORK OF THE PROCESS IS AS FOLLOWS: 
e OPERATIONS CONCEPT 

¢ USER ANALYSIS 

¢ TASK ANALYSIS 

e MAN-MACHINE INTERFACE ANALYSIS 

¢ VALIDATION 


THE PROCESS IS NOT LINEAR BUT ITERATIVE AND 
RECURSIVE AND MUST BE SUPPORTED BY PROTOTYPES 
WHICH EVOLVE DURING THE PROCESS 
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Stanford University Network for Space Telescience Applications Research 


SUNSTAR PROGRAM 
M. J. Wiskerchen — STARLAB/SEL 


e RESEARCH IN PAYLOAD DESIGN, INTEGRATION 
AND OPERATIONS 


o MSFC, GSFC, JSC, KSC, ARC, LeRC cooperative 


agreements 


o Stanford implements distributed network communica- 
tions 


o Use Shuttle payloads as testbed for " TELESCIENCE™ 


research 
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GODDARD SPACE FLIGHT CENTER 
Remote space science operations facility 
Integrated voice, video, computer work station 
CAD/CAE/CAM work stations 
Human factors research for operations and control systems 
Fiber optics local area networks 
Optical disk mass storage systems 
Parallel processor architectures 
Satellite network architectures 
Expert systems for operations centers 
Expert systems for communications control 


MARSHALL SPACE FLIGHT CENTER 
Expert systems for payload timelines 
Local area network architectures 
Payload Operations Control Center studies 
CAD/CAE workstations 
Distributed engineering databases for payloads 
Al workstations 


JOHNSON SPACE CENTER 
Fiber optics local area networks 
High performance work stations 
ADA software architectures. 
Expert systems for operations and control 
High definition and digital video 
Optical storage systems and databases 
Satellite communications architectures 
Digital speech recognition and synthesis 
Speech and video compression 


AMES RESEARCH CENTER 
Robotic vision systems 
Human factors research 
Parallel processor architectures for Al 
Speech recognition and synthesis 
Large computational architectures 
Computational algorithm development 
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LEWIS RESEARCH CENTER 
Advanced Communications Technology Satellite -- system 
architecture study 
Expert systems for space station power-system control & operations 


KENNEDY SPACE CENTER 
Remote testing and integration research 
Expert systems for integration operations 
Fiber optic local area networks 
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APPLICATIONS OF CASIS TECHNOLOGY 


oS TANFORD/NASA CENTER COOPERATIVE AGREEMENTS 


1. GSFC 


ADVANCED COMMUNICATIONS DESIGNS 

HUMAN FACTORS STUDIES FOR CONTROL CENTERS 
MULTIMEDIA WORKSTATIONS 

PARALLEL COMPUTING ARCHITECTURES 

CAD & CAE GRAPHICS SYSTEMS 

EXPERT SYSTEMS APPLICATIONS TO CONTROL CENTERS 
REMOTE SCIENCE OPERATIONS CENTERS 


2. KSC 
AUTOMATION AND ROBOTICS APPLICATIONS TO ORBITER 


PROCESSING, LAUNCH OPERATIONS, AND PAYLOAD 
INTEGRATION AND PROCESSING 


3. JSC 
MULTIMEDIA OPERATIONS WORKBENCH 
FIBER OPTIC LOCAL AREA NETWORKS 
EXPERT SYSTEM APPLICATIONS 


ADVANCED MISSION CONTROL CENTER DESIGN 
SPACE STATION TELESCIENCE TESTBED PROGRAM 


4. MSFC 
ADVANCED CONCEPTS IN PAYLOAD OPERATIONS CONTROL 


CENTERS AND REMOTE SCIENCE OPERATIONS CENTERS 
EXPERT SYSTEM APPLICATIONS TO PAYLOAD OPERATIONS 


5. LeRC 
DESIGN STUDIES FOR THE ACTS PROGRAM 
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Stanford University Network for Space Telescience Applications Research 
SUNSTAR PROGRAM 
M. J. Wiskerchen — STARLAB/SEL 


e AUTOMATION AND ROBOTICS 


o Timeline engineering using expert systems 

o Vision systems in payload robotics 

o Computer architectures for robotics 

o AIT languages 

o Communication networks for robotics 

© Robot systems for payload control 

o Human factors research for man-machine interfac- 
ing 

o Expert systems for payload integration 


1-159 


| *speoljAed 
pue sweaj}sAs uojjeyodsuel}) aoeds ainjn} 40 jUEesIND 
139U0q OF SUOL}Ed);dde jeUoI}ZI9dO paj2ejes dojaaap 
O} USyHeWOPUN 3q |I]JM S$}10J39 UO-MO]]O4 ‘SUW9d}SsAS 
eoeds 30 uojjesado pue uojjes6a3u! 0} Seudeoidde 
jeojHojouyoe; 43oO wuojesjsuOWwSep pue jUusUdoOjeAap 
40} s}oj|d 40 Spaq 38a} sepjyAoid im ,BusldAjo}o1d 
Pidei,, sjyuz ‘suojyzedijdde punoi6 edAjo}01d j0 
yueudojaAep (SyuJuOW fz 0} 9) pides yBnosUu} peagjyuoe aq 
0} 318 Suoj}edjdde wis} se8eN "syOnpoid yoseasas 19U}0 
pue ‘swejsAs BHujbew; ‘sojjoqor ‘aoueBbyjjezuU] Elsie 
JO suojjyeoyjdde wia} ueeu ysijdwoose 0} saAs}e]} UI 
pesyy7os0T/piojueys jujof e sj weibold YHOIS eUL 


1-160 


weiboid (VHOIS) suonesyddy yoieasay 
paalppo0j f=. suoieiado pue uoljeibajuy SwiajsAs ededs 
GYGINVLS 


BASIC THEMES OF THE SIORA PROGRAM 


® AUTOMATION AND ROBOTICS RESEARCH APPLIED TO SPACE SYSTEMS 


- EMPHASIS ON INTEGRATION AND OPERATION 
- GROUND AND FLIGHT SYSTEMS SUPPORT 


* APPLICATIONS DRIVEN RESEARCH 


-TASKS BASED ON OPERATIONAL NEED 
-WORK WITH LSOC AND KSC TO DEFINE INITIAL TASKS 


© A STANFORD/LOCKHEED TEAMING EFFORT 


-UNIVERSITY/INDUSTRY RESEARCH PARTNERSHIP 
-POTENTIAL MODEL FOR GOAL ORIENTED RESEARCH PROJECTS 


© NEAR TERM RAPID PROTOTYPING: 6 TO 24 MONTH TIME FRAMES 


® INITIAL SIORA TASKS WITH KSC; OTHER POTENTIAL TASK AREAS 


INCLUDE A & R RESEARCH APPLICATIONS FOR USAF-SCF, VAFB, 
AEROSPACE PLANE, DARPA, SDI, ETC. 
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ICASE 


Permanent Staff 
R. G. Voigt - Director 
M. Y. Hussaini - Chief Scientist 


Visiting Staff -- 16-20 Ph.D.’s 


Consultants 


Summer Program 


"Product" 
7 Reports 
2 - 4 Workshops/Conferences 
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LaRC Applications 


J 


Mathematical Control Theory 


& & 
Numerical Parameter 
Analysis Estimation 


Computer Science 


Parallel Computing 
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VISIBILITY 


13 Publications 


Second SIAM Conference on Parallel Processing & 


Scientific Computing 


Active participation in variety of other meetings 


4 Staff Scientists 


10 Consultants 
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PARALLEL PROCESSING 


Systems Issue 


Alternative mathematical models 


Numerical algorithms 


Models of computation 


Mapping problem 


Dynamic load balancing . 


Communication & synchronization requirements 


Programming environments 
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NUMERICAL ALGORITHMS 


Modify order of computation to 
1) Increase parallelism 
2) Decrease communication 


3) Decrease synchronization 


Numenical algorithms used for definiteness 
SOR — 1) 
Pivoting in Gaussian elimination — 1),2) 
Time marching for PDE’s — 1),2),3) 


Multigrid — 1),2),3) 
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MODELS OF COMPUTATION 


Predict performance of 
algorithms on variety of architectures 


different algorithms on same architecture 


Permits study & optimization of parameters 


Hardware Software 

# processors problem size 
memory size process spawning 
communication process switching 
arithmetic synchronization 


Using iterative method for PDE demonstrated 
weakness of Inte] IPSC 


Packet size too large 


Communication too slow 
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MAPPING PROBLEM 


Map subdivisions of problem onto processors to 
minimize computation time 


OR 


Find subdivision that permits optimal mapping for 
given architecture 


Research focused on using graph representations of 


algorithms & architectures 


Efficient algorithms developed to find mappings for 
specific graphs -— e.g. trees onto hypercubes 


Technique developed for subdividing domain into subdomains 
of equal work for adaptive mesh problems 


Demonstrated value of hexagonal subdivisions of domain 
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DYNAMIC LOAD BALANCING 


All processors should have equal work 
OR 

Inefficient use of processors 
Longer execution times 

Solution: Rebalance 

Problem: Not easy 

Must account for cost of 
Detection 
Computation of new distribution 


Estimate of performance gain 
Redistribution 


Work focused on developing and evaluating models of 


Computation that can be analysed 
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COMMUNICATION & SYNCHRONIZATION 


Goal: Eliminate Consequence: Algorithms fail 


Reduction of frequency & amount 
Model: SOR for PDE’s 
Advancing in time independently 


Reducing communication cost of global convergence 
Reducing frequency of global convergence 


Analysis of amount & impact for particular problem 
Mapping on variety of architectures 


Model: Adaptive mesh 


Measurement of costs for running algorithms 
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PROGRAMMING ENVIRONMENTS 


Force: Set of machine dependent macros that generate 
Fortran code 


Constructs are machine independent 
e.g. barrier synchronization 


Facilitates programming & portability 
Implemented on variety of machines 
PISCES:; Fortran based virtual machine concept 


Provides view of machine appropriate for user’s 
interests 


Implemented on VAX, Apollos; to be on Flex/32 
BLAZE: New parallel language designed to support 
scientific programming 
Recognition of implicit parallelism 
Implemented on VAX, Sun; next: RP3, Flex/32 
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Figure 2. The coupling of the memory to the world. The memory stores a record of the 
sysiem's past in a form presented to the focus by the system's sensors. The 
record can include features that control the system's motors. Selective 
action can be learned by explicit training and by trial and error. 
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This slide depicts a style and language for 
writing parallel programs. The top third is a 
process-level block diagram of a typical 
concurrent program. This shows an array of 
computation processes (vertical stack of 
boxes) receiving pieces of work from a ticket 
server and feeding results to a queue 
manager for subsequent display. 


The middle portion shows some of the 
program to implement the block diagram. The 
language is Concurrent C, developed at AT&T 
Bell _ and implemented in a translator at 
RIACS. 


The third portion shows how this concurrent 
program "plugs into" and interactive graphics 
application running on a color workstation. 
The inputs to the program are provided from a 
user-interface "control panel" and the output 
drives a graphics window. 
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APPENC IX A 
MEMORANDUM OF UNDERSTANDING 
between 
The University of Maryland 


and 


The Universities Space Research Association 


rpose: 


dints of 


This Memorandum of Understanding summarizes the 
points of agreement between the University of 
Maryland and the Universities Space Research 
Association (USRA) regarding the proposed Center 
of Excellence in Space Data and Information 
Sciences at NASA's Goddard Space Flight Center 
(GSFC). 


Agreement: 


1. 


The search committee for the Director shall be 
a subcommittee of the planning committee for 
the Center of Excellence, and one of the 
representatives of the University of Maryland 
on the planning committee shall chair the 
search committee. In addition, a member of 
the Department of Computer Science will serve 
on the search committee and coordinate the 
search and selection activity with 
departmental review, including all nornal 
university procedures. 


The selection of the Director of the Center of 
Excellence must be approved by the University 
of Maryland, USRA, and NASA. It is expected 
that the selected individual will serve as 
Director for at least five years. The 
University of Maryland will provide a line in 
its budget for the Director, with academic 
year salary for the line. 


The Director will be a tenured faculty member 
in the Computer Science Department at the 
University of Maryland. To serve as Director 
of the Center of Excellence, the selected 
individual will be given 50% release from the 
normal teaching load. 
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Fifty percent of the Director's academic year 
salary, all of the summer salary, and the pro- 
rata associated fringe benefits that are 
normally available to faculty members at the 
University of Maryland shall be reimbursed by 
USRA to the University of Maryland as 
compensation for the Director's 
responsibilities to the Center of Excellence. 


If the selected Director requires 
reimbursement for the expense of relocating to 
the Washington area, USRA will bear the cost 
of the Director's moving expenses. 


Annual salary adjustments will be negotiable 
between the Director and the University of 
Maryland. USRA will honor reasonable 
adjustments established by these negotiations. 


The Department of Computer Science will 
further participate and support the research 
goals of the Center of Excellence through a 
contract between USRA and the University, with 
the Chairman of the Department of Computer 
Science serving as the manager of the 
contract. In addition to USRA's share of the 
salaries of the Director, half-time academic 
year support and full-time summer support will 
be provided for three University of Maryland, 
College Park, faculty members and three 
graduate students. These faculty members 
shall be designated as Staff Scientists in the 
Center of Excellence and shall hold: joint 
appointments with the Center of Excellence and 
the appropriate academic department at the 
university. All joint appointments shall be 
made with the concurrence of the Director, the 
Department Chairman, and the Provost of the 
Division of Mathematics, Physical Sciences, 
and Engineering. 
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8. USRA's ability to reimburse the University of 
Maryland for a portion of the salary and 
fringe benefits of the Director is contingent 
upon continued funding for the Center of 
Excellence by NASA. USRA will exert best 
efforts to negotiate a contract with NASA that 
provides at least four and one half months 
(one academic year at half-time) of salary and 
fringe benefits for the Director in the event 
that NASA prematurely terminates the contract. 


9. The specific terms of this agreement will be 
reviewed annually and may be modified by 
mutual written consent of the signing parties. 


The University of Maryland 


The Universities Space 
Research Association 


Presidént 
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Performance Critical Decisions 


in Parallel Scientific Computations 


David M. Nicol 


Institute for Computer Applications 
in Science and Engineering 
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Mapping of parallel scientific computation to message 
passing architectures is usually domain onented 


=m ee = 


e Workload can change dynamically 


— When should we 
remap? 


e Convergence testing performed 
every iteration 


— How can we avoid 
excessive overhead? 
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Workload dynamics: continuous change 


e eg. Vortex methods for 
incompressible fluid flow 


DELAY DELAY DELAY 


&ésme€ 
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Optimal Remapping Decision Policy 


e Calculation of MDP possible with 
small model 


e Optimal policy knows “too much” 
about system 


Decision Heuristic 
e Attempt to minimize average cost 
per step 
n 
& (maxi) - avg(i)) + C 


i=] 


W(n) = 
n 


e As function of n E[W(n)] has at 
most one local minimum 


e How to tell when W(n) minimized? 


— Approximate with SAR 
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SAR cost © 2 


0.8 w- Periodic remapping, 
cost @ 2 
SAR cost © 8 
z 
0.75 Pertodi 
eri e 
renapping — 
cost = 8 
0.7 
0.65 
no remapping 
0. 6 
0.55 
0.5 
0 10 20 30 40 50 60 70 


PERIODIC: STEPS BETWEEN REMAPPINCS/SAR: AVERAGE STEPS BETWEEN REMAPPINCS 


MUM Model: Performance of SAR Compared with Performance of Periodic Remapping. 


Eight chains, 400 steps, each chain has 19 states, p © 0.5, eech data point 
calculated from 200 sample paths. : 
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Workload dynamics: abrupt change 


e e.g. Multi-phase computations 


Change 
4 


PERF. 
GAIN 


DELAY 


TIME 
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Remapping Decision Heuristic 


e Many decision model parameters — 
difficult to estimate 


e Examined fixed p-threshold policy 


e p é [.7,.8] nearly optimal within 
envelope of: admissible costs and 
gains 


— Difference from NR 
policy depends on gain 


— Keep p high to avoid 
unneeded overhead, low 
to avoid inaccurate test 
Statistics 


— Policy tolerates  mis- 
estimation of statistical 
parameters 


e Conclusion: Remapping decision is 
manageable, focus on determining 
when gain is possible 

° in EN velae? 
° gain potentia!: 
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Convergence Checking 


e Goal is to reduce overhead by 
reducing number of checks 


e Need to balance cost of check with 
threat of overshoot 


e Choose iteration (offset) n to max- 
Imize average number of “useful” 
iterations 
ni 
> Prob{Iteration i is needed } 


=] 


nD+I 
— D iteration cost 


— / cost of convergence 
check 


e Probability terms computed using 
Bayesian techniques 
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Conclusions 


e High performance in _ parallel 
scientific computations requires | 
treatment of decision problems 


— Remapping decisions 


— Convergence checking 
decisions 


e Simple “greedy” heuristics work 
nearly optimally 


e Need to ensure that decision poli- 
cies can be implemented at system 
level 
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Sparse Distributed Memory 


M. Raugh/RIACS 
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This work enta1lls: 


1. Programming a simulator of the proposed architecture on the 
Intel iPSC parallel computer or the Symbolics Lisp machine or 
both. 


NO 


. Developing simple models of an environment and of sensory 
input to and effector output from memory and use the 
simulator to study learning by trial and error in this simple 
environment. 


3. Comparing the models developed in (b) to human and animal 
sensory and effector systems operating in the real world and 
prepare recommendations about further research. 


4. Preparing recommendations about the building of special— 
purpose hardware for sparse, distributed memories and about 
the uses of such memories. 


Or 


Relating findings of this research to facts about human memory 
and perception and prepare recommendations for the design 
of artificial environments for humans, with emphasis on 
environments where the cost of human error is very high. 
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scope of Task 
¢ Feasibility study 
e Assess merits of SDM 
¢ Decide whether and how to build 
e SDMs for real tasks 
° Full—scale VLSI implementation 
e A fundamental question 
¢ How to code the sensory inputs? 
¢ For research applications in 
¢ Robotics 
¢ Pattern recognition 
¢ Cognitive science 


¢ Interpretation of continuous speech 
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Theory Yields New 
Computer Architecture 


e Distinction between memory and processing 
disappears 


e Processing 

e Massively parallel 

e Distributed throughout memory 
¢ 10-100 memory locations on a chip 


e A computer based on the SDM 
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Input Address Data in 
1011001010 TOL T 1 | 1 PO{t1 {oti [oO 


Location 
Addresses Counters 


Pt 
meer ieeape 
ed 
waned © was 
aed &2 pam 
meme © erage 
wae 5 gages 
mee © 
| 
mame EX pene 
me ©) pe 
mod © ee 
aun 
aoaee * om: 
mame ©) pene 
guaee © ee 
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Me COr LT 
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Input Address Data in 


Location 
Addresses 


10710101010 
0101010107 


1100110011 


00110711001 


Counters 


e— 


sum: Li | | | | | | ff 


Dataout: Li | | | | | | ft 
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Head of list (initial item) 


am 
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Main Properties of Model 
Memory 


e Addresses can be chained (linked list) 
e Stream of recall 
e Causal relations 
e SDM Is sensitive to similarity 
¢ If you "know" 600 bits 
e And correctly '‘guess'' 200 more 


¢ You will probably converge to 
correct memory 


e SDM Is capable of forgetting! 


e But can be reinforced by rehearsal 
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eading 1s columnar addition: 


Add corresponding counters from all selected locations 


poo ccc epee s 
apap aes ect “Bh cia tis cee Set, oe ooo 
Heo o ey al gt Set oe a ooo 
EEE a eer are Se OOO 
1 30s HON he ee oe a 00 |] 


Each O-bit results from a negative column-sum 


Fach 11-bit results from a positive column-sum 


1~250 


Writing: 
Each physical memory location contains 1,000 counters 
0 0 0 0 ae ae ee ee ee ee CT) 0 0D 


1001 ........ 00 1 


Each 1-bit adds | to the corresponding counter 


Each O-bit subtracts | from the corresponding counter 
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Addressing 


1,000-bit address 


1-252 


Gist of Theory (II) 


e Sparse, distributed memory 
© Reading and writing at specified address 


¢ (Hamming distance between binary memory 
addresses) 


e Write to locations within radius of 451 


e Yields on average 1,000 physical 
locations 


e Read from locations within radius of 451 
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Huge Virtual Address Space 


e Few actual memory locations 


Any specified address 
(virtual or actuel) 


Neigborhood of given address 
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Gist of Theory (I) 


¢ sparse, distributed memory 
¢ Huge (virtual) address space: 21000 
¢ Few (actual) physical memory 
locations: 249 
e Sprinkled randomly throughout 


the address space 
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Preliminary Assumption 
e 1,000 bits code one moment of experience 


e Fach coded moment serves as an 
address 


e Kanerva postulates the existence of a 
focus 


© Clearing point for data going into or out 
of memory 


< 


e The coding problem is not addressed by 
Kanerva's existing theory 


¢ but will be addressed by this task 
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WORLD | FOCUS | MEMORY STORE 

1 ) 
| 
Physical Sensory | 
signal features ) 
| | 

| 

{ t l n-bit 
! address 


Motor 
features 


Sparse, 


distributed 
memory 
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Sparse, Distributed 
Memory 


e Massively parallel architecture 


e Information stored in large number of 
neighboring addresses determined by 
“content” 


¢ Memory is dynamic: 
e changes with experience 
e learns 
¢ causal relationships 
e time—varying phenomena 
° Memory Is sensitive to similarity 
¢ and itis 
e forgetful !!! 


e (but can be reinforced) 
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Kanerva's Theory of 
Sparse, Distributed 
Memory (SDM) 
¢ A model of human memory 
e Explicit 
e Simple 
e Engineerable 


e Dissertation being published by Bradford 
Books of MIT Press 
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PROJECT: SPARSE DISTRIBUTED MEMORY 


CHARACTERISTICS: 


¢ Highly—parallel pattern computer 
e Based on Kanerva's mathematical theory of human memory 


PARTICIPANTS: 


¢ Pentti Kanerva (RIACS), Project Manager 
e Harrison Leong (RIACS) 

¢ David Nagel (Ames) 

e Michael Flynn (Stanford) 


STATUS: 


¢ Completed simulators 
¢ Building digital prototype 


1-260 


- 


RY 


s/y . 7 = SN OILY DIN AW Wey 


MAIFi et GIL riLaim NYT ssSazv00uW 


SBMONYISY ANVL FH Or) sc / Soc . 


1-261 


22 °7 -YSUN 


Lvizane) oF 


J ABVLISS YO Low} 


SHSISAC DVL VII) ABuL0YIaLs 'd 


ae 


2 BWwWIMIY HdVF 


S/S SNelLIgTWED LYNey YPON] - weleszafy 


Yerpsrey £¢ ‘wi? 2016892 0N, 


aa al ak! LP Oe AC Tate an'7 $OQ 


S/o sv so yeecn 
FV Ol1AYw OIC WO sn a a 
Daria? ay /onas aves /Hu85 
SA 
YQ sa2usssL) JQ s&S3x000 
OBLNVIDLE IC} AN FIIVOD 


AVOUZ] CBYING wey SA Arvous{, AzZIVHC 


1-262 


‘2DEWO/ - 22EW/  WowIAL, SPOVES IL/ 


OG 84 SYRLS vOroRy PEPAIAS OO 


ane /29Y BLYIO7 . 70a 70) 
an Aad ~A*DLOoeYD oO; 
Aven &$ IO“ “PIVSEDY BHIaY °F 
UNWIN /(S IJ DAV DOF 9g 
PLONE VOY D 1700 bt OS ARO 
LJOVHTLNEG Ml TITay wIOreyYy 94 ONS - OME ~ VOOUVH/ S 
§ 
OMS 16 SrVey/ CUetEAle/ 's IVS PY) Bad CNZS 7 
MOD "eB - $90 209 e1eR/ "1b OF ~ 
SAID DVItrey - BL~907 EC OMFS 2907 - OVD” 
AveD = 
WILIED LaBare, 7 DIVIFE/ ££59 708, ‘Idt7 “f/f 
‘SoMmic INSLY YIIC) . $ /asg FVUSEDL/ 


Aveuats oesrvHe wef AWD 


vreus/ NBS «FIFO S¥cIN>YL] IITEMYy 
VIVO, xfs WIBLEAS aovsanl/ »g HD 


® 


WIG AD&D BiwtS'ov - wenxeeclysreg WD 


+ LOO eo 7 CE 
‘O90L/ © ° SwILSAS Bevssal/f ASI 
o/ ad Yd Pd 2 


gO" -W~ ELVNGW BOOVIHMT, “Wel orn 


YOLIVSY BVtiw/7P DIV Cresv—TSO ed] 


LY MALYAYBSIOC 


1-264 


“swsvecs}/ qcrze 407 RL OOS) TINY W BOI WBF aZH™M 
‘payainey VW Sl S9Q IsEBUD asavhn gota, HO! ty 


7 Y PlabD Val, aery waICGVIYy) SOC! 


( 737A R7 @o7 ) DIEUG/ cy avv cs / srewownow Ast @ 


Soy - wunmumewIney 8240 wares e7 vo/any 


Sr otf COWOLAY yey SOC AVOWRS YVVUNS vor e 


ryararvay tery “MWCO ne Abies? ASD Wis ° 
avv Moves Ki FAI H>WE/ 


et BevIgMIVY «I ENEIIOVABT ‘wed »PIENG/ 7%ly « 


> BELvy SeesvoiInAWNed) Os MAIN WY7 oe/ 


cVvelsn 7970) 


1-265 


BayreT 


yao? SswollLyyxyadQ OW! ew Lcly fy 


CAvesisv2 2) 
VOILY VOR YING PVOSLYITIIGD) DOIWUS LOO Ly 


sido Vanvyy weoN) A PBL ELE COD 
a2YIsAvIL ey DYYMIWY/ suynt. sero 


S 4 B7299N/ 2ISVG) 


S40 ° SE rsa ‘s¥yn> Ati nisaanneyD Cee FOO HOIZB(Y - 


an 207¢y Awow a) CVtVIDYPDS ° 


erepsrre ) wiim BHw] woe), - OBIS ILVOH) : 


Avous}) 02023!/ > 9BNLeS WY SSOO”) . 


swessag Avew DL, epyvns / 2TH YY 


1-266 


ALD TIOMME) het) 7 | PAvP/ $497 YON 


rary) /OPL99'WLEIC; PINLO ‘suena ewinery BvWy gay 
DHTIVAASRS $9/SS 1405 sranaelg weep, *28700T) T7O7 . per 
PD PlwIDA 24 Peeve’) 
Press WWOSOT ,, DLV ILM / PLD 199NC7 
oprvepsceg OD = 21°FY ayer 
00 sroremN FAG e 
> & Gap “an eis ies ad o 
| . 
hid ik, PURLIIA ) £3 anne") (a»20s8 vet) oe *A/2r"s 
- * 
00 DHVR Bu, 1vOMS 
COLASAHSS OT BLtvsIlInh/ / VEY PIISAT) 
Opar0E SY Ivory 
JQ SNO WOPNIDOMASLS 
avers / 12413 @ 


srersvardt svously wsvy om/ 


1-267 


| ha rrerveu He) yo slOT = 9121012 7VY NevIas Fy 
727 VOY ¥ gasco Viet(/ raat Tr? 22071990 yaso7”) 
09179810 3A 
LarngszrVw2 °A2F ‘sevesv VRID 709040H/ 29vEE RL ve payw2rt3ay ° 


asosary A0er+S arene, 42Rernd) aves] nIL8F escrgued? U 


1-268 


CVelbD FI 79S ? 


corsyris(sOaor, 993907 sid DOOD avumovyy . aveH eH esvvrc ‘LSC 


a! 
AVOuUs.s CHMVUNS asf 


quam r C 
me Vp VOODGHD VFINVAOY/ nereeke B2vdIS 10S 


aan V7 "rh /(PRy 7”79'2R07 wry SuBwl SAS 


ovr iog se) 2999 VHY/ or’ oe. ly! al $7} 2 orev bd ¥/ Ox WH) wot/ ° 


ee OA Lod 7y amsgarvaMer) 


JASD/VSVN 
ISNUBIDS YONeESeYy s0I1UeS 
sqooer °9 Aueg 


WALSAS GIAVG SHL 
--LNANADVNVW ASVEVLVG 
Q3LNEldLSid SNOANSDOYS13H 


WSLSAS (GIAVG) 3SVSVLVG 
GILVUSILINI M3IIA SS3IDIV GILNGIULSIG 


v-v 1s00NTd 


9861 ‘64 “AON 


1-269 


009 3100) 


ILVUOLOIVIG 
| $3IN3I1DS 
Hivw3 8 JDVdS 


(SGVN) NELSAS “UASVOOO 
VLVG SOISAHGOULSV VSVN J3N Wel Gas SO Wel AVYO 
(SIND WA.LSAS NOLLVWYOSNI dN-1vid SSYUON SWA NNS 
INSWAOYNVW TVOINHOSL L3N LIQ 3 MVYHO(LBLY) XINN 909 
(SCIN) NALSAS VLVG GNV1 VSVYN ISNO30 zag (GS) XINN XVA 
(SGON) WALLSAS V.LVG NV390 VSVN 13N WdlV SWI Sod wel 


‘VLVG NIVLEO 
Ol YAGHO NI SGOHLAW SSA00V LNSY3SS3I0 ANVW 
NYV371 OL SAVH SYUSDVNVW GNV SLSILN3IOS VSVN 


‘Wa Tdoudd 


W3iSAS (GIAVG) 3SVEViLVG 
G3LVUDILNI M3IA SS3IDDV GILNGINLSIO 


009 300) 


1~270 


(SVN) WALSAS “UASVd0O 


VLVG SOISAHdOULSY YSYN LSNWEl GBs SO Wal AVYO 
(SIND WALLSAS NOLLVWHOSNI dN-1vVId SSHON SWA NNS 
LNSVEDYNYW TWOINHOSLL JBN LIS JDVYO(L9LY) XINN 900 

(SIN) WALSAS VLVG GNV1 YSYN 13N030 cag. (asa) XINN XVA 
(SGON) WALSAS VLVG NV300 VSYN LAN WduVv SWI sod wel 


W3LSAS (GIAVG) 3aSvavLvVG 
GaLVYD3ALNI M3IA SS390V G3ILAGIYLSIG 


-‘NOLLNTOS 


WSLSAS (GIAVG) 3SvVEaVLVG 
G3ILVUDSILNI M3IA SSIDIV GILNGIULSIC 


&-v tece0NN 


1-271 


e-v weeoud 


SATYOM CIAVC MOH - 
WHLSAS VIVd SOISAHdOULSV - 
WHISAS NOLLVULSNOWHAC - 


dIAVd 4O MGAIA S.4HSsn - 


é6qIAVd SI LVHM - 


XIV.L AO ANITLNO 


WSILSAS (GIAVG) 3SVEVLVad 
GILVYUSILINI MIIA SSIDDV GILNGILSIC 


ILVEOLOIVIG 
SIJINIDS 
HLUV3 3 3DVdS 


1-272 


"NALSAS 
SNOLLVOINNINWNOD SNOFNADOW LAH V SI GIAV © 


‘WALSAS 
ONILVaddO GaALNEra_Lsid SNONADOW_LAH V SI GLAVG ° 


WaLSAS INYNADVNVA ASVEVLVG 
GaLNdraLsid SNOYNHYOOWOH ANO'TIVGNVLLS V SI GIAVG ° 


‘SESVEVLIV"G CALNE aLsid 
SNOFYNHYOOULAH ONISSHOOV AOS WHLSAS V SI GIAVd © 


&GIAVG SI LVHM 


WIISAS (GIAVG) 3SVEVLVG 
GILVUOIINI MIIA SSIDIV GILNGULSIC 


HLVV3 8B 39VdS 


1-273 


(34a) cag) WZ (434d) (34q) WV 


VIVd NVWOuUd X VLIVG NVUDOUd X 


(33a) (3aq) a (Jaq) (Jaq) i 
AYNDOTVLVYD ANNOTVLVD ANDOOTV.LVO ANOOTVLVD 
ee ail cy 
(LOOW / 


GIAVG dO MAGIA S.waSsNn 


WILSAS (GIAVG) 3SVEVLVG 


G3ILVUSIINI M3IIA SSIDIV GILNIULSIG 


HivV3 8 3DVdS 


1-274 


SING SHYONT eee KT 


SAS WdidO XINN 
qd1no9 


WALSAS (GIAVG) 3SVEVLVaG 
GILVESILNI MIA SSIDIV GILNGIULSIC 


1-275 


SSH G 
—— 
QeSeoe 


WHLSAS VLVG SOISAHdOULSV AHL “Il FSVHd 


W3LSAS (GIAYVG) 3ISVSVLVG 
G3LVUOILINI M3IA SS3IDDV GILNGINLSIC 


HLUV3 B IDVES 


1-276 


| al ae sa : 
SOON DOO Ft] 
WON SOONG 
SmUUUN NOLLV TWV1SN8 wWrieos KEATON NIA 
Vv 6 8 a 9 
VON PON 
VON SAUL Rd ON IO Ov 
ee EE aes ay Bs 
BOAISNOO SSE Guiness fj 3uy REED 
: : : Ba 
. Seow E te] SOON SONS 
ZWVREIN 
PWE sO WS ee weeenl 


M@IAMZAO WALSAS 


SNAG AVG 


W3LSAS (GIAVG) 3SVSVLVO 
G3ILVYOIINI M3IA SS3IDDV GILNGIULSIC 


HLUV3 B 3DVdS 


1-277 


THaddWvo TM 


9861 ‘61 WAG IWAAON 


SUSSadVOdd 
DINGHANHOVNVA V.LVG 
INQOVTTaint 


1-278 


GONGIAAdXA GNV DONIGNV.LSYAGNN 

aSVaViLVd TWWINIAN AAVH LVHL SYasn dO 

GONVA AGIM V LYHOddNS NVO WALSAS FHL LVHL HONS 
SUMANIONGA LAOddNS GNV SLYGd Xa ASVAVIVG ATV 
“ADGCATIMONM FO dnNOWD FALLOATIOO V AIT NOLDONN 
TTIM LVHL SA9IANdS GNV SNALSAS LNAINADVNVA 
VIVd GHONVAGV dOTHAdd OL ATAHISSOd SI LT 


YaLNGD VLVG 


AINAIOS ADVdS HOUVASAY WOU SISHHLOdAH 


IVNOLLVN 


VSVN 


1-279 


SNOLLVOlTddV 

JIIDadS NIVNOG AO ADNVA GVOU V WO SATOALV ALS 

HOUVAS ONILUOddNS GNV SMAIA ASVEVIVG WIdIL Tw 
4O NOILLVLNGANA TIA AHL MOTTV TIM SWNALSAS LaddXa ss 


TIVWS SI NIVNOG NOILVOITIddV OMIOddS ANV YOu 

GNV ‘GaLIWIT WAHLVY ATIVNASNA SI SLOAdO TAAASN AO 

YWAGANAN TWALOV AKL ‘SLOadO VLVd JO WaGANNN AUVT 
V GAVH NVO SAUSVEV.LVd TVWNOILVaddO LSOW HONOHLTV ° 


ADGA TMONS TV ANGHOOUd 
YO OLLSINNAH NO GaSV4 aaV SYASN ASVaVIVG 
LYaAdXd Ad GANYVOANAd AAV LVHL SNOILVaddO ANVN > 


aTaISSOd 

SAIDOTONHOSL IV GALVTAY GNV SNALSAS LYad Xa 

40 NOLLVOIIddvV AHL SAIVW HOIHM dOVdS JOCATMONY 
Ga LINIT WAHIVA GNV ALINIG VSVH USVEVLVaG Vs 


YALNAOD V.LVG 
GONATOS JOVdS 


SISHHLOdAH GHEE YOu SISVa 


TVWNOLLVN 


1-280 


NOLLVAYOIN] 9 ‘TWALXEL 
430 NOMOVULSEY TWORKOUVUSIH 


asvaviva VLAW 


NOLLVAYOINE ‘TVILVdS 
40 NOLLOVYLSHV TWORKOUVAGIH 


NOLLVNNYOINI TWILVdS GNVY VLIW OLNI 
VLVG ‘IVELVdS MVY JO NOLLVWNYOASNVUL 


LSADNI VLVG LNASITITSINI 


NOLLVAYOANI FP FOVNONVI 
ANgINGO SwWad VIAW 


NOILVWYOINI 
y saaagnd TWILVdS 


(IVLLVdS % LX3LNOD ‘OLLNVIWGS)/XVLNAS ° 
SHIDSLVULS HOUVAS F TOULNOD ° 
ADGTIMONN TWANLOALIHOUV SWAG 8 TVANGINONd ° 


QOVAGGLNI WAS LNADVPTTS.NI 


HSTIONA A, 


VSVN 


YWaALNGAO VLVG 


AONAIOS OVS LdS3ONOO Wal 


IWNOLLVN 


1-281 


YWaLNaAO Viva 
GONADS FOVdS 
"IVNOILVN 


SdIHSNOILV13Y NIVNOG LOATEO IWALYIA 
NIVWOG NOILVONddV 

OL SdIHSNOILV1SY LOArgO VLVG 
3DG4 IMONy 

DILSILYNSH OlsIO3d$ NOILVONMddV 
IDGIIMONy 

WHNGSD0Yd Dis1IO3dS NOILVOMddV 


NOLLVWNYOINE ‘WALXSL 
JO NOLLOVULSEV 


aSvVavivd VIAN 


WOTHOUV AGI 


SdIHSNOILV 134 
GNV NOILVOISILNAG!I LOSFEO WNALYIA 


4ADG3 MON» 

OILNVWWAS 8 LXSLNOO ‘XV.LNAS ASVEVLVd 
SdiIHSNOILV1SY 8 LXSLNOO LOSraO VLVG 
JOGAIMONY WHYNLOSLIHOUV 
SLOSPAO VLIVG JO ANONOXVL TVOIDOT 


NSISSAG SADVSAESLNI YASN 
INSADITISLNI AO MAIAUSAO 


* 4-282 — 


-YSVN 


DXA 
HSTTIONG NIVId NI WaSN AHL HLM G@LVOINNWWOD NVD 


YdSN AHL AG ONIGNVISYAGNN ANV LAOHLIIM A TING 
“TOM GNV ATCIdVu ‘ATANLLNOW Gasn SI ASVAV.LVG 
4HL HOTHM YOu GNVANAG NOLLVANYOANI ATONVH NVO LI 


AWANO 
AZZNA V ONISN AG GASSAUdXA AGI NVOD SLUAONOD AZZNA ee 


AWANO ASINAUdWI NV SV HONS ‘WASN AHL 
Ad G4LVLS ATALIDITAXA LON AAV LVHL SNOISNTONOD 
YNIAGAINI AG@ ONINOSVaAY ALVIAIXOUddv LYOddAS NVO Ls 


VLVG FHL NIHCIM 

SLOGfdO NAAMLAG NOLLVTAY AHL SV TTAM SV V.LVG 

40 NOILLOATIOD V 40 SONINVAW GNV SLNGALNOOD FHL 
YNIAMIOGdS AG ONIGNV.LSYAGNN ALVLITIOVA NVO LI 


YWALNAD V.LVG 


BINAIIS AVES SHLOVMWAVdVO INI G4Loadxa | VSYN 


1-283 


SHdVa9 TWALddONOD ONISN AG SMAIA 

GaLV THY Wasn FHL OL MATA TWNOLLVYAdO ASVAV.LVG 
GHL NOW NOLLVANYOUNI ASVEVLVG 40 NOLLVOLAI 
“LNAGI GNV ONIGNV.LSYHGNA NV ALVLITOVaA NVO 


YaASN TWASVO GHL OL ASVAV.LVd FHL NI 
CaHywOLS NOLLVNYOANI GNV AYALOALIHOUV ASVAV.LVG 
GHD 40 NOLLVINGSAdaa TVOIDOT V AGIAOUd NVO 


YWOSSAIOUNd ANANO ADVNONVI TVUNLVN AHL HLIM 


NOLLONNINOD NI SGHUN V.LVG S.WaSN AHL SNIGNV.LS 
"HHaNN YOU SISVG OLENVIGS AHL SV HAWAS NVO 


UALNAIO V.LVG (GANNLLNOD) 


TONNOLLYN SHLLITIGVdV) INI GALOAdXA 


1-284 


SMHIA ASVEV.IVG 
SNOLTAVA qHL NqdMLad NOLLWISNVUL TVOISOT MOTIV TIM 
LVHL SHdVad TWAlddONOO NO GaSV4 SdSSdOO0Ud dOTAAGG > 


SMATIA NOLLVOIIddV AIdILINN - 
MATA TWANLOALIHOUV NV 


<aSVAVLVG 
VIG SHEL fO SMATA JO SHdAL TVWUNAD OMI ALVAYD 


1-285 


ASVGV.LVG TWhalov dH 

INASdadda OL AUVSSHOAN ATIVNOLLVUAdO ANLL ANVS 

aH. LV GNV 44S GdHL OL ALVIadOUddV ATTIVNOLLONNA 
dav LVHL SMaAIA AW ASVEGVIVG VLAN AHL INGSadddy— ss 


IWNOILVN 


au vaya. SLdADNOD NOISAC SINI /VSYN 


SHdVa9 ‘IVALdHONOD ONISN ASVAV.LVG 

TVILVdS GHL GNV VLG GH NQAMLAG SV THM 

SV ASVEV.IVd VLG SHE 40 SMAIA AHL NI GHNIV.LNOD 
NOLLVAYOANI NHUMLAG SANIT TVOISOT V AGIAOUd ss 


SLO4fdO VLVd 40 SLAS GNV SLOGdO VLVd 
4O ONINVAWN SYS GALE GNV ONINVAA S.ASVEV.LVd AHL 
NGHAMLAG GALWISNVUL OL SHdVAD TWALddONOD ASN 


GONVLIMGHNI GNV SdIHSNOLLVTAY GALNARIO 
LOardO LYOddNS TIM LVHL LdGONOOD GaSvd ANVW 
V ONISN MIA ‘TWA DLOALTHOUV CHL LNASANdaY 


GOGCTTIMONS 

TWanddoOdd GNV OLLSINNAH LYadXxa SAANLdVO 

LVHL SASSd00uUd ONINIVHD GUVMYOVE GALAN 
TVO9 HLIM SMHIA NOLLVOIIddV AHL LNGSaadaa ss * 


HOVAMALENI WAS INADITTALNI FHL tO 
LNGNdOTHAdd FHL LYOddNS OL SNALSAS LYadXad ASN s+ 


YaLNaO VLVG 


NaS aoe HOVOUddV NOISH INI 


1~286 


M3IA ¥3SN 


Y (IVNOILLV 134) 
M3IA ASVEVLVG 


VIWSHOS TVNIdSONOD 


> 
mt 
2) 
7 S a1avL 
= 
m 
© 
—_ 
: de 
e vatava| | © 2 avL 
” 
©) 
ms 
uD TWnlLdONC 5 _ _ 
HdVud IWNLdsaONOO V = ¢ aavi b JTIaVL 


YALNAO Viva 
Bee Aa HdVuU9 ‘TWALdHONOD V JO NOLLV.INASANdaa 


1-287 


wasn 
dSWavLwd 


30 %o%e ae 


(SGNVLSUzaNO (AWONOXVL 1V919D07) 


UgSsn LUadXa AHL LVHM) 
MAIA NOILWOIITdadY 
aSVaVLva 


M&A 
TWHNLOALIHOUV ASVEVLVG 


WALSXS LUadXs 
UALTIIA WIOASNWUL 
NOILWOIITddY 


MALSXS LUAdXaA 
USLIIAZ MIOASNWUL 
NOILWOIIddY 
OL ‘TYNOILYUZdO 


HALSXS LUAdXKa 
WaLIIA NAOASNWUL 
TWUNLOALIHOUY 
OL TYNOILVUadO 


~ 


(IZGON IYNOILWISN °3°T) 
MALIA 
TWNOILWUSdO ASWAVIVG 


WaLNAOD VLVG 
GONAIOS JOVdS 


“IVWNOLLVN 


C—O Ol eO Se 


1-288 


GSVGVLVd AHL LAOGV ADAG 

“MON” SLYGdXad NV JO LTNSAA AHL SILA ASVaAVLVd FHL 

NI A’'TALVIOITAXA LSIXA LON S00 LVHL SNIV.INOO V.LVG dHL 
LVHL NOLLVANYOANI LNASAUda AGHL ASNVOAG G4SISVHAWGA 
YGAO AG LON NVO SLOaLgdO TVALYIA JO AONVIYOdWI AHL 


SMATA NOLLVOITddV FHL NI GaSN A INIV.LAAD 
LSOW Wav AGHL ‘Y4AGMOH “ASVEAV.LVG AHL AO M4IA TVEN 
~LOALIHOUV FHL NI GALNASANdAY LSad AV SLOALdO TWALYIA 


aSV@ ADGAIMONS V HLIM GHD VNVA 
GNV GaMLLNdGI ad AINO NVO SLOAdO TVALUIA ‘A LLINASANd 


LOarao 
MAN V WYOd OL (SLOardO ASVAVLVG TVAW SATANOL TVAAATS 
40 DNIVGLSNTO FHL dO LINSAY FHL AV SLOAdO TWALara 


(SLOaradoO Gaya4Ni 

GaTTVO SHALLAWOS) SLOULdO TWALYIA GATIVO ASVAVLVG 
4HL NI LSIXG LON Sd0d LVHL LAG LNOGV SMONSM WaASnN 
Ladd Xd dH LVHL SLoafrdo aSVaV.LVd AO SSVI) V SI Tada 


SONAIOS JOVES SLOALGO IVALYIA /VSVN 


1-289 


(194° Od SOINVNAG IVLSNHD) SSVEVLVG OISILNSIDS 
AWNOILVH3d0O HLIM WALSAS 3dALOLOUd SHL SLVHLSNOWSG 


YSATIOHYLNOD 
LNAWADVNVW GSaSVd 3903 MON» SHL OL HOLVISNVUL 
MMOLVINWYOS AYSND V GAOVAYSLNI GNV JdALOLOUd ‘NDISAG 


SSISOTONHOSAL WALSAS LY3dX4 ONISN 
YSTIOULNOO LNSAWSDVNVW GASVE ADGATMON® TVILINI AdALOLOUd 


YOLVISNVYUL/YHOLVINNYOS AYSNO - 
YSATIOULNOOS LNSAWASDVNVW GASVE SDGAIMONN - 


-“SINSJNOdWOD 
DINIMOT1IO4 AHL HLIM SDVAYSALNI YASN LNADITIALNI 
ANO S3SVHd AdALOLOUd GNV NDISSG ‘SLVINNHOS 


YALNAD VLVG 98 Ad SNODOS VWSVN 


GONADS AOVdS 


TWNOLLYN INAWSSDVNVW VLVG LNADITIALNI 


1-290 


| 
| 


SADHNOSSY YALNdINNOD GNV STOOL 
ONISSSDOUd AYSND GNV WALSAS LYSdX3 AG GALINITSAdALOLOUWd ° 


ONINOSVAY JO ANIIATONIS °° 
ONINIVHO GYVMAOVE GsaLOsHIC TVOSD OL GSLINIT SNINOSVSYH—* 


SATEaVL SNILYOddNS GNV 
S3A1NY NI GANIVLNOO SLOV4A NIVINOG GNV S3SV¢E ADGA IMONN HLOG ° 


M3IA NOILVOMIddV JTONIS) se 


NOILVINNYOSNI TIVN.LXALNOO GSLINIT HLIM NOILVLNSSSY¥dsuY 
AHOYVYSIH G3AISIGOW V NO G4aSV¢d MSIA IWHNLOALIHOUV 


NOILVOIIddV 
8 IWHNLOALIHOEV -GaLNASSud3y SMSIA ASVEVLVG OML ° 


¥GINGD Viva YATIOULNOO LNOW GaSVd JDGAIMONy | ywowyn 


GONADS FaOVdS 


TVNOLLWN TVILINI 40 SSILITIGVdVO 


‘1-291 


in JNU in 2INY 


WOWININAG GaLYOddNS AHOYVHSIH TVDIDOT V 


J1NY SI M3IA NOLLY 
A NOLLVONIddv NI GALNAS3Hd3HY SUNLOALIHOUY ASVaVLva 


a 
i 
i 
! 
aes 'n S3Inu ~ o in anu 
'N 3IINY <«——'w Mou <——'wN 37INnY § 'n SInu <«——'N Sou <«——'n anu 
Q 
ure ‘ nN ‘ 
$ ; ‘ 
' watne j ' N3INu 
ae 1 <a 
a 
| 
CNousand) i . 
' ql 
l a 
i 
i 
i 
u 
nn 
, | 
i 
N3AING VOD aasva ! SLOSPEO VLVG NSSML3IE dIHSNOILV13u 
i 
i 
a 


SONAIOS ADVdS NOISAG YATIOULNOO WE» TVILINI 


‘IVNOILVN 


SLOSPraO ASVEVLVG 1W3Y 4O ONIHSLSN19 SHL 4O 
LINS3Y FHL AYV HOIHM SLOSPEO TWNLYIA AGN IONI LSNW WALSAS SHL 


| SASVaVLVd LNOGV ONINOSVau 


SMAIA ASVEVLVG SNOINVA SHL 
N3SMLAG NOLLVISNVUL SHL MOTIV SHdVHD TVWNLdSONOD 4O 3SN SHL 


YASN AHL AO NIVINNOG 
ASVNONVT SHL NI WALSAS LY3dX43 SHL NI NOSV3Y OL H3SLL3G SI LI 


XVLNAS 
SLISV T14M SV ASVAEVLVG V OL SOLLNVIWSS GNV LXSLNOO TVNOILVYSdO 
JHL HLOG SNILNSSSAYd|3Y AO SNVAW V S0GIAOUd SWALSAS LY3adX3 


WALSAS 
143dX3 NV DNISN SM3IA SSVEVLVG SHL ALVSYHO OL 31ISSOd SI LI 


SMA3IA TVNOILVYAdO GNV TIVOIDOT VW HLOG ONIGNIONI 
SMAIA JIdILINW HLIM SSVEVLVG SHL LNASSYdSHY OL AYVSSSOAN SI LI 


BONAIDS ADV4S SLTASAY HOWVASAY 


TIWNOILVN 


1-293 


ASVEVLVOG DISILNSAIDS IWNOILVYSdO NV 
YOd JUVAYALNI YASN LNADITTALNI NOILVYSNAD GNOOSS V SdALOLOUd 


NOILVINYOANI G3Y3SSNI 1VOSD GNV LXSLNOD 
YNISN YHOLVYANAD NOILSAND G3ZIVYHANAD V 4JO LNSAWdOTSARG— 


(SWVHDVIG ‘SdVW “5'3s) SLOZEro 
VLVG 13A31 HDIH 4O SNIGNVLSHSGNN GNV LNAWSDVNVW LHOddnNs 
OL VINSHOS AWVH4 NI SLOSPEO VLVG IWOIHdVHD SO NOISNIONI 


SYNLONELS 

VLVd G3SV¢ SINVds SHL NI LNSYSHNI dIHSNOILV14u 

YALHONVG/LNAYVd ONIZITILAN M3IA WHNLOALIHOYV 
NI LXSLNOO LOAaraO VLVG SO NOILVOISILNSGISHL - 


VINSAHOS NOILVLNASSYd3y G3ASVE AWNVYS V ONISN ANONOXVL 
WOOT V NO GASV4E MIA IWHNLOALIHOUV SASVEVLVG- 


‘SLYOddNS LVHL YATIOULNOD LNAWADVNVW 
G43SVd ADGA TMONy GAONVAGY NV SO LNSWdOTSAS0 SHL 


YWa.INAD V.LVG Z8Ad HOS SNDOS HOYUVSASSY VSVN 


GFONGIOS AOVdS 


AYNOHEYN INAWSSDVNVW VLVG LNADITISLNI 


"1-294 


SW34180ud D1SIDAdS NOILVOMddV YO4 SUNLOALIHOUV JSVaVLVG a 
OINVNAG V LHOddNS LVHL SASS3OOUd NOILINDOOSY NYALLVd ONISN 
MHYOMLAN HOYVAS IVWILdO 4O NOLLONYLSNOOD SWIL-1V4Y YVAN se 


SLOsrao 
VLVG IWILVdS ONV VL3IN HLOG SLYOddNS SHNLONULS ViVG- 


SNOILVYSdO GTHOMILINW 
A@ GaLYOddNS (ONINOSV4Y AO SANIT ATdFINW LNSYYNONOD) 
NOILO3TAS GNV NOILLVOISILNAG! LOAPEO VLVG TaT1IVHVd OGaNSd~—s- 


OSNINOSVSY GHUVMNOVE 
GONV GYVMHYOs LNFHYNONOO AG GALUYOddNS HOUVAS LOArGO VLVG - 


ASVE JIN DisIDAdS NOILLVOMddV HLIM NIVINOG M3IA 
WYN LOALIHOYV T1N4 JO LASENS V SI NIVNOG M3IA NOILVOMddv- 


JONVLIYAHNI HLIM AYNLONYLS VLVG GASVd SWVHS Ag 
G4LYOddNS dIHSNOILV13Y LXALNOO 11N4 HLIM SLOSraoO ASVaVLVG 
JHL 4O NOLLVLNASAYd]aY TVOIHOUVYSIH V SI MAIA IWHNLOSLIHOUV 


G3LNASSd3Y SMIIA NOILVOIMIddV GNV IVHNLOSLIHOYYV JTIdILINN > 


1-295 


oxausaovas | YATIOULNOO LWOW GaSVd JDGa1MONy | VSWN 
GAONVAGV JO SALLITIGVdV9 


C nousano )  (_Noussno) (_Noussano ) 5 NOIDJY AlId UOI VIVO 
i 


a” 
° ae 


—_ a 


i 
In ane vane 
7 
iy ya TWOLLSILV.LS 
N 31ny <——' wn anu «——'Nn atnu sf y, 
[ty — area) 
'nN atnNY a a“ 
4 - 
i er we 4O dV M3IAUSA0 
7 i a“ 
—e Oe | _->_WivaViaN 
7 - = 


a - 


A 
+ 
A 


—_ 
a 
a 
a= 
a” 


as 


aos” 
a 
aa” 


i 
_ _ 
_ E s— 
_——— ©” Anat AllorWNOsu OL NOG 
TIVINIVE OINVISO LOWS 
e 
oat eT] — i | _SNV3IO | S3LV1d | | SLNANILNOO | 
~ | 
7 
| 
| 
| 


7 cm 
any 
ne, 


= san S3LVLSGSLINN 


NOLLVDIGLINAG! 1VOD SUSHdSOWLY| | USLVM | | GNVT | 


I 
A a 

- _ 
eet SUNGSINVITIM 
oe 
IF 


| aTHOM 
5 VINSHOS NOILVINSSS dda ANVYS NI 
(GALOAYIG 1VOD) M3IA NOLLVOIIddv sy SLOSPaO ASVEVLVG JO ANONOXVL 1V9IDO1 
wawaoviva | = =YATIOULNOO LWOW ASVe 3D0da IMON» 


TWNOLLWN GSONVAGV 4O M3IAYAAO NDISSA 


1-296 


SWad GNV WALSAS SWaEd GNV WALSAS 


L¥adX3 NASML3ag YOSSA00"d AHSNO 1¥3dX3 NA3SML3d8 YOSS3900Ud AY3SNO uae 
ADVNONVT IWYNLVN AG GaLy¥OddNs SDVNONVT IVENLVYN AG GaLYOddNS = 
SWE OL NOILVINNYOS AYSNO : SWad OL NOILVINWYOS AYANO : 


 ATLINSYYNONOD ONINIVHD 
QHYVMHOd NSAING VLVG OGNV 
ONINIVHD GYUVMNOVE N3AAING 1VOD ° ONINIVHD GYUVMNOVE NSAING 1VOD 


SSII0"d ONINOS V3 


ONINOSVSY GTIHOMILINN 
AG GaLHYOddNS HOYVAS VLVO TSTIVEVd : 


1-297 


AYNLONYLS VLVG 
NI JONVLIYSHNI AG GaALYOddNS LXALNOD : 


SLOAPraO GNV STVOD 
JisIDAdS ONILOATAS AG GALVAYD 
ATIVOILVAOLNV SMSIA NOLLVOMddV . 


S1903fgO/SAWVU AO ANONOXVL 1V9IDO71 3SVa@ JINY NI GAGNIONI 
V NI GSLNASSYdSy SYNLOALIHOYUV SLOV4 GNV SYNLOSLINOUV ASVEVLVA e 
JUNLOALIHONY ASVEVLvVa 
GSUNVAGV TWILINI 


SNOSIHVdWNOO SDNVINNHOSHAd 


VINYOSAIIVS “VN3GVSVd 
ASOIONHOAL AO ALNLILSNI VINHOSINVO 
AYOLVHORVI NOISTINdOYd LAr 


LOYWVHOHOE * 0 AHVD 


Telit 


VLVd YSALAWOYLOAdS DNIDVINI 
JO SISATVNV SHL HOS 
WALSAS LY3dxX3 NV 


1-298 


wil 
G2 HLONSTIAVM r'0 Q3YS3LSID3SY ATLNSYSHNI 
‘SAGNVGE IWHLO3dS 00Z-00T NI 
ATSNOSNVLINWIS 
NSNVL SIDOVAI 


STVINSLVIN 

JOVANNS SHL ASILN3GI 
Ol G3aSN 38 NYO LVHL 
WNYLO3adS SNONNILNOSD 
‘G3LVIDOSSY NY 

SVH 13Xid HOWS3 


1-299 


LL S VLVG IVNIDIHO 


SayuNLVASs 


ey ee ee ee 
AdO1S 

LL 
AGNLIdNV 


VLVQd 
WadLosadS AO NOILVLNSSSud3y 


leit 


1-300 


‘SAIONSAOVPAV 
‘ALIYVIINIS SAO SNOIDAY 


‘VIVd ADVANI AHL WOYS 
"SNOILSSDONS “SNOILVLOAdX3 

-G43SN AHL WOYS 
‘SNOILVIOOSSVYSALNI 
‘ALINNIEVLS “SONVGNNEV 
‘SNOILVOISISSV1O TWHANIN 


-A90 IVYANIN/ADO 10455 


NOILVNYHOANI AYVLNAWAlddNS “ef 


1-301 


VLVG VLVG 
WWOIMSWNN | oMOoOgwas 
sayunago0ud 
JMOGWAS 


SSduNGsA900"d 


TIWOlANAN 


(ONINOSV4Y GSLVWNOLNV HOS IOOL ATdWIS) 
HVLS .cIr 


1-302 


‘TIGVIHSVH, “JNILNOY 9, SNOILOINNOD 
‘([¢ tv) (€ e2)puedde ‘(€ 2)+ SNOISS3udX4 


{ 


and} << anjen 


g< aun} SauO03 

‘C] ‘(60 9° 2°0) Sis 

‘ AWeIIWIS JO aiNnseaU,, SONIYLS 
‘ATALANW 'WANIWNTV SNINOL 
‘y'00T ‘L2- r SYaaWnn 


(SLINN) S2YNLDNALS WLVG AVIS Ter 


1-303 


LS!i1 ¥VLsS 


[" 6LLOIdv SLOIdv] <— 


(AYWNIG SI pLOTdv 
[" 6LLOIdv 2Ze@LOIdv SLOIdv]) SALVGIGNVS 


leit 


1-304 


{ { 

OCS90E LOTd, <- eiep | O9PSOE LOTd. <- eep os 
901g <- JO Jaquiouwl INOIQ <- Jo 1aquioU 
© ALILOI <- oweu} [ ALILOId <- oweu} 


{ 
[ajoqryduwe 9SPJIOYWO d}1AOdsnuT] 
<- YIM pajerosse 
21q¥1sun <- AjrIqe}s 
UOWWOS AIDA <- souepunqe 
[] <- sassejoqns 
[7 ainorq | 9N0IQ] <- sroquiow 
BOIW <- JO ssejoqgns 
SSP]D <- JO JaquiOW 
HLILOIG <- sweu} 


1-305 


SLONULSNOOD UV.LS Id NVS 


{ 
NOILONNA AONVILSIC Oy <- WyI03|e 


¢ <- sjuduINns1e U 
. TMAGAAN., 
JO anjeA oy) AQ POUTWID}9p SI pasn dinseow, 
SOULISIP PUL POYJOW SuIpooud IejNoed sy], 
‘TLOTd, Puke TL LOTd, ‘si0jd om) Jo ssurposua,, 
ol] UIIMI]9Q JOURISIP OU) SOINSBIIA] 


UHaWNAN <= (LUAGNOAN CLOTd, TLOTd) 


<- JUSWIWIOD 
uolouny uonedydde do <- Jo Jaquisul 


AONV.LSIC <- sweu} 


Tel 


1-306 


nN NEG 


S INALSAS 
IOYLNOO JAAILVILINI-GAXIIN 


leit 


1-307 


ONISNAS 
ALOWSY 


ALIYVITINGS 


Waisas \WALSAS wasn 


ISSYSLNI AO SVSEV NOISIOAG 


1-308 


HOYVsAS 


ASILNAGI (uaisn0) - 


ALIAILOV 40 SNOOSA 
Nel 


ALIAILOV 
INAYYND 


@ LSSYSLNI 
WALSAS 


V LSSYSLNI 
d3asn 


=| 


1-309 


t qeaLSNTDAa OL WHLSAS 
SLOHUId ANV SYHLANV avd 
UNIYHLSNTO SYALTV ass 


NOLLVuadO ONINaLSAIO = ef 
TVLLINI SWYOAaAd WALSAS 


f NOILVaddO ONISAHLSNT aos 
SUALHINVAVd SHNINAALAG 
ATIVOILVNOLAV WHISAS 


AKXILNAGI OL VIVG AHL AO 
SNOLLOXS SSO SMAIA AHS!) 


1-310 


t. STIVUANIW GALOAdXa ANV 
LNAWNOUWIANA SHETYOSAC YSN 


DNHAWDHAS SISATIVNV HIdNVS tm | 


VLVG S9VIWI AYVEEIT TWHLOAdS 
ISVG NOILVANNYOANI OIIOGWAS 


SNOILONNA TWOlYWSINN 
Sa 1Nd GNV SNOILONNA ONOGWAS 
TOYULNOO SAILVILINI-GAXIIN 


WaLSAS WNdlLoiads 
JHL IO NOILVZINVSUO 


1-311 


9861 ‘O0c-8]) J9qWaAON 


mnisoduks eotuyoay, 
smiayssg Byeq / aadualog iaynduo) 
VSVN 


Jajua) Yoivasay Aalsuey YSVN 
‘ap ‘ypLeyyog ‘gq aed 


NOILLVGIIVA GNV DNITACOW ‘AAVALAOS LNVEdTOL-LINva 


1-312 


BAVITIGSIII YStY Futaat yor 10; 
AGazVIYS aAljOaJJa Ue AOUSPUNPAI JIeMZJOS S] 


SaIN[Iej JUSPIOUIOD ‘onsést [eyUoMIepung — 


} sauapuadapul ‘Ay IqReorldde 
‘uoTyeorpn(pe ‘aouemiojiad /peaysaao ‘s}s09 


SONnss] 


SUOTJOUN] [BOTJIIO UOISsIW a[,;nYS soedS YSYN 

wWa;sks WMOPJNYS JOJOBA JealoONTG epeuey jo AdlIauq O1ul0};y 
swazysks U1} Jazijiqe}s pue radmep aek sc, sutsog 
sUOlyOUNY [O1},UOD AYSI[} [BONWIID QOE-LEL Fulaog 

WozsksS [O1ZUOD JIJJel}, speol[Iel 93878 YsSIpaas 

[os}UOD dejj pues jes OEY saliysnpuy snquly 


uolzyeoT[ddy 


DIBAPJOS [BOIZIIO UI 
S}[NBJ [ENplsal ysulese asuajap e se sOURPUNpay 


CL6I — Yoieasoy/soeooapy e 


CNNOWDIOVA 


1-313 


‘SONDIUYII] OIBALJOS JUCIATO}—} [NJ 
0} AJOayy swiayshs Jo Ayt{iqeorjdde ay} aulwsa}aq 


uorjyeotfddy 


‘(sulted AyI[Iqeljal) ADUepuNnpad alemjyjos 
JO SSIUAAT}JIIJJO 9} UO eyep [edIJIdWa apIAolg 


syuUOWIIadxy 


‘aINn[Iey] JUSPLOUIOD 0} yoolqns are syuauUOodWOD a19ye 
QIB@AM}JOS JUePUNPaI suizA[eue JOJ j[apow dojaaag 


sUI[OPO,{ 


SHATLOALdO HOYVASHY 


1-314 


Jaqy}jado} sulpieyl Jo aaidagqg 


‘qOld a 


(1siq Ayisuoyut)y = “d sna weownd 


sulueaw sey A}ISUD}UI JIN{[Ie] JO uotynqi4sj}SIp Y 


és ULU BOUL Ca) eq" 
Lanai, ‘d) y= Ny Ga) nay LIAVA NOISAG 


gSUOISISA JDIVM}JOS SUOWL SaIOUapUad|ap xXa[duloOd aay} aly 


1-315 


LINVd ‘IVOISAHd 


MOIA JIeMpIep 


AONVONNGHY ONITAGCOW 


uol1youny AyIsuazuy = (x)e 


{ £ > (x)o ix | 
woTynqi4ysiq AyIsuazUy] OP | = (4)9 


(1+N) N 
(4)op pan #0) 6 (7 | « | = d 


SI Ny ain[Iey wiaysks jo Ayt{tIqeqoid payoodxa ay} 


§ UOI}qII}SIpP adesn uUoUTWIOD eB WolsJ aie syndul (2) 
ajdues Wopuel e WOlJ pajoa[as aie syuauodwosa (7) 


-JBYU} SUOI}IPUOD ay} JapuyQ 


AUVMLdOS LNVGNNdHY ONIZATYNY 
YOd SISVE TWOLLHYOdHL V ‘THCOW YOddd LNACIONIOO 


1-316 


SUOT}BOTJloeds Surpearsru ‘deajoun jo yoeduy ¢ 


1-317 


90Uapuedapul Jo SUIUBIW «¢ 
Aouepunpay jo [9Ae] WNnuUI}dgG »¢ 
Aduepunpad jo SUOTJEIUIIT » 


PAtyoasja st AQuepunpad uauy 


‘1O SISATVYNVY SHCIAOUd THQOW YOUNT LNACIONION 


6A01I9 JU} DYOAUIL [TIM 
}UaAa Ue }eYY AYI[Iqeqoud ayy st jeUM 


(yaidsazyuIstu 0; Ayrsuadoid) 
gyUaTOIJJaoo AyIsuazUT oy} ST JEU 


‘ma[qoid ay} ynoqe YUIYyZ 07 ASM 
VB Sopraoid uotynqiiysip Azyisuayul ue jo ydaouod ay], 


‘ASNOdSdHad LNAddhy 


,2SIOM BIEMJJOS DY} SOyeW }],, 
(wa[qoid ssaippe 0} MOY yNoGe dulziuose Yyonu 19};Je) 


“ASNOdSHa LSVd 


Za1e@a}jJOos JuepuUNpal 
UO UOIyBOTJIOads GUIPBVEl[sIM eB Jo yoRedUI OY} ST VEUM 


1-318 


: £4daje1}s JoOaIJoou! ue aq 0} Aouepunpais sasneo yey ye 
ss eisonpraenouseciedetansepmara ioscan 


yJ-Ol X ae c—OT x 9'9 2 
g—-Ol X T'J c-OT X G’9 t 
c-Ol X Q'9 c-Ol X¥ 0'°9 J 
[apow [2pow SUOISIOA 
9oUapusdapu] WaAD 19q WINN _ 
Ng p 


y-O} -— | = (0)9 pus p—Ol = (9°)9 asoddng 


Ayisuazyuy ainpreg }UaPIoUIO) 


dg 
eae 


[d]t4dq = dg dg 


[Woreyaidiojzur jAOOUI Ig = Tg 


'qoig 
JOdi9 SSONpU! YoIyA yUaag = ¥ 


OT G Q 


c’ <q papunoqg (Q)3 
UOT}OUNJ sseul AjIsuazyUI art 


"AYI[IQeI[ad asordwut 0} Ouepunpal Jo] (A1essaoou 
}OU 4NqQ) JUaTOTJJns st styy ‘(jrey £ywourw e ‘a‘T) 

G° UBY} SSO] SI SUOTSI9A YOSIIOOUI Jo uol;,I0do0i1d 
[Vorjyatoayy 94} “suoryIpuoos yndul ajqiseay [je 10j ‘J] 


(JOpOW JOIIY JUSPIOUIOD) sASNOdSTY LNAYAND 
(c' > d syauns pue) d > Ng &+c' >d 
(j@poul aquapuadapy]) -ASNOdSHY LSVd 


gUOISIOA a[sUIs @ UO SUIATaL 
uey} Adazyes}s aalyoajja alow e ouepunpas st uauy 


1~320 


Further, p < .5 4 Py <P 


Probability (P.)) 
of system 
failure 


] 5 9 64 l7 2l 
Number (N) of components 
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